-- Logs begin at Fri 2022-09-09 05:49:13 UTC, end at Fri 2022-09-09 06:43:54 UTC. -- Sep 09 06:14:37.538994 dv-cinder-852209-16-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 06:14:37.546277 dv-cinder-852209-16-smb devstack@keystone.service[81423]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 06:14:37 2022] *** Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: nodename: dv-cinder-852209-16-smb Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: machine: x86_64 Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: clock source: unix Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: pcre jit disabled Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: detected number of CPU cores: 4 Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: current working directory: / Sep 09 06:14:37.549649 dv-cinder-852209-16-smb devstack@keystone.service[81423]: detected binary path: /usr/bin/uwsgi-core Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: your processes number limit is 47680 Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: your memory page size is 4096 bytes Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: detected max file descriptor number: 2048 Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: lock engine: pthread robust mutexes Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: thunder lock: enabled Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 06:14:37.551853 dv-cinder-852209-16-smb devstack@keystone.service[81423]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 06:14:37.588424 dv-cinder-852209-16-smb devstack@keystone.service[81423]: Python main interpreter initialized at 0x5640d5bc39c0 Sep 09 06:14:37.588424 dv-cinder-852209-16-smb devstack@keystone.service[81423]: python threads support enabled Sep 09 06:14:37.588424 dv-cinder-852209-16-smb devstack@keystone.service[81423]: your server socket listen backlog is limited to 100 connections Sep 09 06:14:37.588424 dv-cinder-852209-16-smb devstack@keystone.service[81423]: your mercy for graceful operations on workers is 90 seconds Sep 09 06:14:37.588834 dv-cinder-852209-16-smb devstack@keystone.service[81423]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 06:14:37.588927 dv-cinder-852209-16-smb devstack@keystone.service[81423]: *** Operational MODE: preforking *** Sep 09 06:14:37.589137 dv-cinder-852209-16-smb devstack@keystone.service[81423]: *** uWSGI is running in multiple interpreter mode *** Sep 09 06:14:37.589137 dv-cinder-852209-16-smb devstack@keystone.service[81423]: spawned uWSGI master process (pid: 81423) Sep 09 06:14:37.589339 dv-cinder-852209-16-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 06:14:37.591892 dv-cinder-852209-16-smb devstack@keystone.service[81423]: spawned uWSGI worker 1 (pid: 81437, cores: 1) Sep 09 06:14:37.591892 dv-cinder-852209-16-smb devstack@keystone.service[81423]: spawned uWSGI worker 2 (pid: 81438, cores: 1) Sep 09 06:14:37.591892 dv-cinder-852209-16-smb devstack@keystone.service[81423]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 06:14:41.927076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:14:41.927076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Sep 09 06:14:41.927860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:14:41.927860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Sep 09 06:14:41.927981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:14:41.927981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Sep 09 06:14:41.928393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:14:41.928393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Sep 09 06:14:41.978164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:14:41.978362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:14:41.978556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] command line args: [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:14:41.978827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:14:41.979005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ================================================================================ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:14:41.979253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:14:41.979339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.979452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:14:41.979539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_dir = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.979654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] command line args: [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:14:41.979737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.979848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_source = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.979924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:14:41.980030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] debug = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ================================================================================ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:14:41.980233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_dir = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.980996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_source = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] debug = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_config_append = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.981939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_dir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_config_append = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.982926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_dir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.983989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984417 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.984954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.985876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] publish_errors = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.986982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.987143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.987378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.987614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] standard_threads = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.987805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.987921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] publish_errors = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_journal = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_json = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_stderr = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.988959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_syslog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.989131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.989210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.989443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.989590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.989674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.989945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.990024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.990171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.990420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.990502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] standard_threads = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.990657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.990858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.990938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.991130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.991206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.991329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.991404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.991519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_journal = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.991598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.991763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_json = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.991847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.992069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.992146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_stderr = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.992315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.992404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_syslog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.992552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.992823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.992904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:14:41.993071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.993872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.994861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.995973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.996953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.997999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.998944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:41.999782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.000358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.000543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.000632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.000818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.000908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.001986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.002915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.003924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.004911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.005999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.006963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.007994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.008966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.009917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.010897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.011852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.012974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.013995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.014961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.015140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.015217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.015380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.015464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.external = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.016932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.password = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.token = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.017979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.018902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.019884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.external = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.020862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.password = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.token = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.021831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.022977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.023947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.024945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.025992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.026965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.027918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.028863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.029845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.030992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.031954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.032940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.033998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.034931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.035941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.036973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.037951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.038890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.039991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040447 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.040938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.041997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.042981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.043978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.044956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.045990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.046962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.047925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.048896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.049858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.050966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.051935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.052928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.053888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.054884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.055879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.056844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.057994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.058978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.059951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.060931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.061877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.062033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.062112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.062273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.062866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.063869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.064851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.065962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.066929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.067808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:14:42.067887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.068132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.068374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.068642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.068885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.069124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.069373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.069613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.069861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.070100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.070352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.070590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.070838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.071075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.071319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.071560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:14:42.071734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:14:42.097342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.097576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.097797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.101029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.101267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.101497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.106526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.109939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.134771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.135007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.136410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.136670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.189185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.189313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.238662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.238895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.239477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.239717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.395948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.396087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.396170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.396311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.396531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.419951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.420637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.432186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.432483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.444999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.445992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.446082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.446212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.446294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.446438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.446652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 06:14:42.463506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.463716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 06:14:42.463803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.463926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 06:14:42.464058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.464257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 06:14:42.464354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.464466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 06:14:42.464548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.464775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.464865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.465043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.465126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.465308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.465388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.465572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.475260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.475541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.475624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.475817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.475900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.476102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.476194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.476392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.483116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.483436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.486540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.486830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.486911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.487115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.487949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.488913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.489098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.489181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.489374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.489455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.489647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.511999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.512379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.513498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.513789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.513871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.514151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.518994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.519283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.519364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.519569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.519651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.519935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.525911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.526203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.526403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.526711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.531818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.532118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.532379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.532463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.532706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.532789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.532990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.533897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.534094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.534375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.549809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.550091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.550408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.550700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.553962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.554567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.557231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.557532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.557841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.558142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.561746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.563018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.565469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.566292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.568727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.569952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.570152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.570234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.570437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.570719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.571000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.585906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.586204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.586475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.586742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.586876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.587170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.587446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.587718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.593637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.594660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.595188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.596207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.596751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.597038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.597789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.598082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.599936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.600221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.600507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.600818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.601030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.601228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.601321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.601599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.601889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.602296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.612925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.613210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.613492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.613776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.614141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.614931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.615318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.615614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.615900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.630655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.631949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.633590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.634895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.636633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.637838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.638090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.639299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.639555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.639841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.640238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.641337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.641626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.642035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.647176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.648460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.648667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.649970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.651570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.651972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.652264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.652550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.652913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.653316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.653608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.653889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.660931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.661235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.661522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.662373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.662680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.662966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.668381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.668694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.668984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.669267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.669548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.669826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.669908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 06:14:42.670104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.670961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671807 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.671886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.672083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.672212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.672371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.672695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.672995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.673307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.673615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 06:14:42.706525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5640d5bc39c0 pid: 81437 (default app) Sep 09 06:14:42.708137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5640d5bc39c0 pid: 81438 (default app) Sep 09 06:14:42.709754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cf71-72b8-4ef6-95d4-b1b91f8aca40 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:42.710044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cf71-72b8-4ef6-95d4-b1b91f8aca40 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:42.710319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cf71-72b8-4ef6-95d4-b1b91f8aca40 None None] PATH_INFO: `/v3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:42.714496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Fri Sep 9 06:14:42 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:14:49.513381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:49.513894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:49.513997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:49.518857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:14:49.523968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:49.524550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:49.524550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:49.604638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: INFO dbcounter [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] Registered counter for database keystone Sep 09 06:14:49.624399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG oslo_db.sqlalchemy.engines [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:14:49.631645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writer thread running {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:14:49.810439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81437) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 06:14:49.810759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81437) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 06:14:49.871967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:49.874399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:50.024372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 06:14:50.314577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:50.382929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: INFO dbcounter [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] Registered counter for database keystone Sep 09 06:14:50.403560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:14:50.410155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writer thread running {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:14:50.527482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8573d-b09a-447d-888d-86a7a017057f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:50.532234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:50.532877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:50.533159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:50.533433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:50.541412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:50.593259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 06:14:50.594158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe4c1d-9f90-4922-ad44-df4452a193d6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:50.603547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Sep 9 06:14:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 06:14:50.609637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:50.626230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56f58-d85a-44ed-bc61-eac304755a16 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:50.630666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:50.631782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:50.632071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:50.632349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] PATH_INFO: `/v3/projects/39226271c3254aef844c491c22cbe083` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:50.633975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] RBAC: Authorizing `identity:get_project(project_id=39226271c3254aef844c491c22cbe083)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:50.686758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 06:14:50.687104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ef8b-20d8-47c8-8e05-2c197cbb1812 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:50.691601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Sep 9 06:14:50 2022] GET /identity/v3/projects/39226271c3254aef844c491c22cbe083 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:14:52.787124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8ded-a674-47fd-908e-35687b62a2ce None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:52.787630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8ded-a674-47fd-908e-35687b62a2ce None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:52.787710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a8ded-a674-47fd-908e-35687b62a2ce None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:52.791785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:52.797813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:52.798211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:52.798373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:52.818583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:52.820093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:52.827829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 06:14:53.091111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8ded-a674-47fd-908e-35687b62a2ce None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:53.103283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a8ded-a674-47fd-908e-35687b62a2ce None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:53.107393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:53.107994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:53.108277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:53.108554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:53.116670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:53.118430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba72f9-6253-4859-87ce-d46cd3ce0bac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:53.127482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Sep 9 06:14:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:14:53.132729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:53.144360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bccf-440d-4b4e-a120-2e5760ffca6a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:53.148788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:53.149418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:53.149705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:53.149985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:53.151299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:53.153165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d65910-2b46-4272-b074-2c8014f76ed9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:53.154679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Sep 9 06:14:53 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:14:55.367272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74945b6-e5b5-4f06-8c29-6dc912b938d6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.367833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74945b6-e5b5-4f06-8c29-6dc912b938d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.367833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74945b6-e5b5-4f06-8c29-6dc912b938d6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.369167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:55.371762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2e5-0144-41fd-a794-8cedbb1be142 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.372192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2e5-0144-41fd-a794-8cedbb1be142 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.372323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2e5-0144-41fd-a794-8cedbb1be142 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.373666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:55.374191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.374507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.374865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.378825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.379115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.379397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.397439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:55.398609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:55.416889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 06:14:55.417271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 06:14:55.466449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:55.467950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:55.479703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:14:55.566003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:14:55.748831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:55.774742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:55.829863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:55.857062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8a31c-4b84-47cc-a56e-476be324d6ee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:55.891420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:55.892089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.892374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.892702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.929001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae76de0-0311-45ca-b21e-9dca5082005e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:55.931332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:55.965823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:55.967300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:55.968511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:55.969653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:55.969940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:55.970215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:55.982640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:14:55.990701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:14:55.991630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:14:55.992918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:14:55.993894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:14:55.998596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.070997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:14:56.076444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.101715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12758-2923-4465-b04e-6f59e8835bdf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.135235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.136026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.136492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.136810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.137481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:14:56.137789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.139227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.150749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:14:56.156839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.172776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056997da-8747-4f0a-8935-8d1279d7d296 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.183842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:56.197457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:56.210009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.210641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.210921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.211195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.220899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.222361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:14:56.240626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:14:56.241581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:14:56.242434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:14:56.242434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:14:56.242434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:14:56.242434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:14:56.247853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.261306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487e89-2e71-45da-99ec-98b1345a6df8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.295143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.295771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.296058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.296324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.297897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.299336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.300915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:14:56 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:14:56.306217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.349464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de329ada-9041-482a-a181-46b0e60c3d05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.383207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.383904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.384258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.384634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.385569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:14:56.385569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.386953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.397238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:56.404569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dbb08-ad7f-4319-8224-1a4982a3d7e6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.410490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:14:56.445370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.446022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.446304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.446578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.447717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.449217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7c0bd-f7e6-495d-9904-e38e205017ca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.450806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:14:56.457570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:56.493703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:56.565164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4658b-9364-4424-88a4-63ee4383ef87 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:56.600027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:56.600607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:56.600892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:56.601165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:56.601889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.domain.id=default, user.id=ceee5fe8c66c4818ace9872367307903) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:14:56.602199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:56.603629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a117c1-cb77-41df-a20c-34a3532728f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:56.610881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Fri Sep 9 06:14:56 2022] GET /identity/v3/role_assignments?user.id=ceee5fe8c66c4818ace9872367307903&scope.domain.id=default&role.id=ab615789e49a44a7956ada7180efdd20 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:14:58.994156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff255-edb9-4004-aef6-cecd7aff515a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:58.994699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff255-edb9-4004-aef6-cecd7aff515a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:58.994699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff255-edb9-4004-aef6-cecd7aff515a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:58.996159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:59.001671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a37-de35-450f-9969-2e4ed97527fb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.002085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a37-de35-450f-9969-2e4ed97527fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.002246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2a37-de35-450f-9969-2e4ed97527fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.025713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1a7a2a37-de35-450f-9969-2e4ed97527fb None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:59.026931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1a7a2a37-de35-450f-9969-2e4ed97527fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:59.051256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90468-1c36-4b1e-87e0-ea9c53d9c474 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.051566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90468-1c36-4b1e-87e0-ea9c53d9c474 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.051813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90468-1c36-4b1e-87e0-ea9c53d9c474 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.053149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 12/23] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:14:59.058240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dcd6-26ee-4ae1-8f22-f63676fd5c3f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.058530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dcd6-26ee-4ae1-8f22-f63676fd5c3f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.058812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dcd6-26ee-4ae1-8f22-f63676fd5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.088428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5ae7dcd6-26ee-4ae1-8f22-f63676fd5c3f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:59.090292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ae7dcd6-26ee-4ae1-8f22-f63676fd5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:59.159035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 06:14:59.210867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:14:59.428820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e34f-350d-4776-854f-2aed759d6311 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.429483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e34f-350d-4776-854f-2aed759d6311 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.429972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e34f-350d-4776-854f-2aed759d6311 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.431527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 13/26] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:59.436978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.437273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.437549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.465505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:59.466700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:14:59.547943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:14:59.595099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317e34f-350d-4776-854f-2aed759d6311 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:59.637037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:14:59.652591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:59.676913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:14:59.761538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4fb4-779f-45b1-bf6d-34ae98213db3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:59.777236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317e34f-350d-4776-854f-2aed759d6311 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:14:59.818631 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:59.819661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.820145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.820625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.841972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:14:59.842926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.844003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.844715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.845607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:59.851280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:59.860124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:14:59.861878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ebbe93da-c009-4561-9204-6ab7ca21b60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:14:59.894590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:14:59.895540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:14:59.896337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:14:59.896337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:14:59.896337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:14:59.898516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 15/28] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:14:59.899901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936188a6-8ff3-4473-b368-83f60e43d081 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.900409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936188a6-8ff3-4473-b368-83f60e43d081 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.900957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936188a6-8ff3-4473-b368-83f60e43d081 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.902810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 16/29] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:14:59.908236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:14:59.908806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:14:59.909277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:14:59.928545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:14:59.930124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:00.000297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 14/30] 10.222.0.30 () {60 vars in 1131 bytes} [Fri Sep 9 06:14:59 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:00.001156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.017878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 17/31] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:00.018790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.022428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:00.132926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeea41c-39ed-4aa3-9c92-153aeb4ad551 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:00.174087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:00.174726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.175010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.175286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.175974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:00.179061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:00.194381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:00.221620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccaf17-b5d7-48a5-8180-503e2e919a7f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:00.292259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:00.292901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.293192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.293471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.294143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:00.294456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:00.296001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:00.317706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 15/32] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:00.323073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.359212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 18/33] 10.222.0.30 () {60 vars in 1131 bytes} [Fri Sep 9 06:15:00 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:00.454906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf76d-d6f1-4a3b-875b-ad927b488430 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:00.472207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.504521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:00.505206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.505496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.505778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.506538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:00.508014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b408d-0f94-4c56-92bb-53d8373c7625 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:00.547758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:00.567264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 16/34] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:15:00 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:15:00.589044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:00.606490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b75c79-0563-421f-9964-961cfe2990f0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.606820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b75c79-0563-421f-9964-961cfe2990f0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.607065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b75c79-0563-421f-9964-961cfe2990f0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.609176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 17/35] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:00.617660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.618277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.618771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.635705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8e2c4-72c2-4ee2-bdf8-2c3272b5d64a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:00.663153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:00.664780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:00.677364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:00.678029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.678346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.678597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.693244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:00.700897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:00.701801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:00.702671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 19/36] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:00.710884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.761134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 18/37] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:00.828688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0be85-6372-4e9a-9227-af301a6f7570 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:00.853306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:00.864732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:00.865357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:00.865647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:00.865917 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:00.866593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:00.866902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:00.868410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac42c88-9ee5-4ca0-b839-97e4858682c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:00.877657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:00.884446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:00.999055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ade6-c85e-4bc2-a9f9-283c83aa3427 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.028798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:01.031266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc8b5-5b5b-41f3-a52b-dc34d85c0373 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.031747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc8b5-5b5b-41f3-a52b-dc34d85c0373 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.031946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc8b5-5b5b-41f3-a52b-dc34d85c0373 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.033293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 21/39] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:01.035927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.036595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.036949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.037182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.038489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.038608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.038842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.039192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.039944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.041645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 19/40] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:00 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:01.042271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:01.059682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:01.061228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:01.128714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:01.129476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:01.142649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3ff7a-7f25-4c80-b620-bd318a4e23ee None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.179107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.179810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.180005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.180396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.183365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.183365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.198135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 20/42] 10.222.0.30 () {60 vars in 1131 bytes} [Fri Sep 9 06:15:01 2022] POST /identity/v3/roles => generated 223 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:01.250733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ace8d-f406-4e9e-9340-b9a125d0ad43 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.270599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:01.294950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.295611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.295894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.296733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.297878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.299355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.301275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 23/43] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:01.306859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:01.374102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:01.400388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:01.514340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2787-9cf2-4592-802f-cbdc6e39e0aa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.527317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a14ea-1353-4ce7-ba53-9bf66ad10faa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.549393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.550025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.550310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.550589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.551693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.553170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.554748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 24/44] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:01.560285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:01.561650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.562314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.562595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.562874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] PATH_INFO: `/v3/domains/default/users/ceee5fe8c66c4818ace9872367307903/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.564802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ceee5fe8c66c4818ace9872367307903, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.566215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1ff86-d1a2-404b-bb25-2ba8f4a5457f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.580189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 21/45] 10.222.0.30 () {58 vars in 1361 bytes} [Fri Sep 9 06:15:01 2022] PUT /identity/v3/domains/default/users/ceee5fe8c66c4818ace9872367307903/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:15:01.615663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:01.666334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9db4-2bc1-4f88-aa75-7c4849914ed5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:01.701156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:01.701785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:01.702067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:01.702375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:01.703055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:01.704526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c14df-99c1-4c89-a75a-3d9917c91c96 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:01.736607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 25/46] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:15:01 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:15:03.751335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a932a0-8dc4-488b-ab2a-6d7c7ed52f16 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:03.751849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a932a0-8dc4-488b-ab2a-6d7c7ed52f16 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:03.751957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a932a0-8dc4-488b-ab2a-6d7c7ed52f16 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:03.753279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 22/47] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:03.758468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c2aa-8983-4dd0-b418-cfb3d68d1d6d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:03.758866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c2aa-8983-4dd0-b418-cfb3d68d1d6d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:03.759031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c2aa-8983-4dd0-b418-cfb3d68d1d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:03.777471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f056c2aa-8983-4dd0-b418-cfb3d68d1d6d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:03.778640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f056c2aa-8983-4dd0-b418-cfb3d68d1d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:03.846184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 26/48] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:03.934997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58823f-443c-4cae-948d-e000a2a93d17 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:03.935290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58823f-443c-4cae-948d-e000a2a93d17 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:03.935574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58823f-443c-4cae-948d-e000a2a93d17 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:03.937447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 23/49] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:03.942735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:03.943028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:03.943307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:03.961508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:03.962663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:03.988156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.028585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 27/50] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:04.110835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58823f-443c-4cae-948d-e000a2a93d17 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.215038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58823f-443c-4cae-948d-e000a2a93d17 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.231726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.250004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.250664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.250949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.251229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.262146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:04.268425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:04.269291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:04.270052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 24/51] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:04.275440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.295031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.373454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f90a9-bad2-4df9-994f-49748f652641 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.393217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0a58-a13b-447e-8f91-37f196a9a65f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.430141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.430799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.431082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.431357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.432551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.434062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.435688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 25/52] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:04.441502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.490353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.510672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.511286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.511577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.511854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.512518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:04.512865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.514242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.522161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 28/53] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:04.527880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.543195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce5991-3af2-45ea-868b-cb5125a8d6d4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.556909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.576217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.576853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.577136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.577439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.578098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.579545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.607427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 26/54] 10.222.0.30 () {60 vars in 1140 bytes} [Fri Sep 9 06:15:04 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:15:04.632071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177bfb-cb62-4242-acdb-4f616645f1e4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.668533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.669248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.669529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.669800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.671776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.673193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.674824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 29/55] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:04.680624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.782024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.786113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c479871-60a0-4b19-9a6a-ceef4a20fbd1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.822576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.823146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.823429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.823703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.824836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.826288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69f43-dcc8-4f28-b964-ceae976cf1df None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.828346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 27/56] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:04.834326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:04.926782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:04.933843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971edf84-eabc-4900-a4b9-e2a57d20d64a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:04.967258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:04.967874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:04.968784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:04.969068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:04.969797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.domain.id=default, user.id=ceee5fe8c66c4818ace9872367307903) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:04.970118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:04.971548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8de78-e730-4afd-ab87-a9ebf42ce685 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:04.980919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 30/57] 10.222.0.30 () {56 vars in 1322 bytes} [Fri Sep 9 06:15:04 2022] GET /identity/v3/role_assignments?user.id=ceee5fe8c66c4818ace9872367307903&scope.domain.id=default&role.id=ab615789e49a44a7956ada7180efdd20 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:06.757167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38110-4017-4d5e-80d3-019df37e1eca None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:06.757686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38110-4017-4d5e-80d3-019df37e1eca None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:06.757789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38110-4017-4d5e-80d3-019df37e1eca None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:06.759033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 28/58] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:06.764033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:06.764401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:06.764710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:06.782687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:06.783859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:06.846476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:07.108240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38110-4017-4d5e-80d3-019df37e1eca None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:07.206384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38110-4017-4d5e-80d3-019df37e1eca None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:07.239176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:07.239805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:07.240085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:07.240355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:07.241484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:07.242906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d70b1-d3cc-42a3-b0ee-2b1cc098e9d5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:07.244437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 29/60] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:07.249914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:07.333480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:07.345705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a513c0-caaf-47f5-8d4a-531e4647c47c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:07.377849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:07.378394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:07.378680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:07.378957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:07.379599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:07.381075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63847e9b-8a8f-451a-9e06-7c00e98228ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:07.406983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 32/61] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:07 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:10.730097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cbae6-4081-4c8d-a8a1-ef78a944ce34 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.731138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cbae6-4081-4c8d-a8a1-ef78a944ce34 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.731621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cbae6-4081-4c8d-a8a1-ef78a944ce34 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.733193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 30/62] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:10.739013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee467-72ee-484b-971f-f8e001c29bcc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.739457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee467-72ee-484b-971f-f8e001c29bcc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.739628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee467-72ee-484b-971f-f8e001c29bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.745285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fd3e-0ba0-4237-8fc5-6370d25acd0a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.745795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fd3e-0ba0-4237-8fc5-6370d25acd0a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.746286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645fd3e-0ba0-4237-8fc5-6370d25acd0a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.748187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:10.754342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378791e-938b-49a3-9175-42e9afd2350f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.754894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378791e-938b-49a3-9175-42e9afd2350f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.755381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378791e-938b-49a3-9175-42e9afd2350f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.769605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cf1ee467-72ee-484b-971f-f8e001c29bcc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:10.772189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf1ee467-72ee-484b-971f-f8e001c29bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:10.778258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4378791e-938b-49a3-9175-42e9afd2350f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:10.779835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4378791e-938b-49a3-9175-42e9afd2350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:10.844954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:10.892795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 33/64] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:10.922579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:10.954608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605900-c127-42e5-be56-4a5acd190986 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.955256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605900-c127-42e5-be56-4a5acd190986 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.955733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605900-c127-42e5-be56-4a5acd190986 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.957605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 34/66] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:10.962760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.963262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.963737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.985815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eddb0-d3ca-42a9-aafa-5bc0904650df None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.986374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eddb0-d3ca-42a9-aafa-5bc0904650df None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.986861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eddb0-d3ca-42a9-aafa-5bc0904650df None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:10.988360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 35/67] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:10.990121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:10.991519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:10.993133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f5be4-f878-4455-8236-ec7868545458 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:10.993617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f5be4-f878-4455-8236-ec7868545458 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:10.994103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f5be4-f878-4455-8236-ec7868545458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.022626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-322f5be4-f878-4455-8236-ec7868545458 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:11.025538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-322f5be4-f878-4455-8236-ec7868545458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:11.134912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 33/68] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:11.148406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 36/69] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:11.252372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.254283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f5be4-f878-4455-8236-ec7868545458 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.262986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.424897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.433828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5fd65-94ec-40f7-8f79-faa651fcebea None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.441758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f5be4-f878-4455-8236-ec7868545458 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.471867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.472870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.473352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.474116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.485421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:11.487733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448b913-e319-4790-8da4-254208a39553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.488377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448b913-e319-4790-8da4-254208a39553 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.488697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448b913-e319-4790-8da4-254208a39553 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.488979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448b913-e319-4790-8da4-254208a39553 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:11.491171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:11.492024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:11.492803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 34/70] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:11.493451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.505971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448b913-e319-4790-8da4-254208a39553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f448b913-e319-4790-8da4-254208a39553 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:11.510792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:11.511934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 37/71] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:11.517854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448b913-e319-4790-8da4-254208a39553 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.583398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.610188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d531e-caad-49b2-806d-c780b6281a18 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.626638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448b913-e319-4790-8da4-254208a39553 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.647335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.648005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.648296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.648610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.661048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:11.666114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:11.667190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 35/72] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:11.668139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.671783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.672494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.672818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.673117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.684734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:11.685549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:11.691027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:11.691882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:11.692681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 38/73] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:11.693955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.778285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cfa9-3b53-4ee0-a223-c3eeb7a7fd3e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.800554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973badf-03fa-45c8-8811-95c32ec7e647 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.811652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.812278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.812591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.812878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.813545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:11.813855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:11.815279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:11.824497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.826625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 36/74] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:11.828094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.836859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.837480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.837767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.838048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.838725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:11.839036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:11.840457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:11.849741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 39/75] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:11.849741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.908298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:11.930712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcb2ba-f14a-4d61-9731-6fec0d573bf1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.950480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c81f9-834d-4c39-b8e8-7cd012ffcdfd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:11.963479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.964088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.964367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.964667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.965333 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:11.965637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:11.967008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5423fe5-92a4-4462-9397-69560f671d4e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:11.975834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 37/76] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:11.977073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a3be-872f-45ef-9075-ac06602981c4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.977178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a3be-872f-45ef-9075-ac06602981c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.977381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a3be-872f-45ef-9075-ac06602981c4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.978677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 38/77] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:11.979258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a3be-872f-45ef-9075-ac06602981c4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:11.986354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:11.986972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:11.987260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:11.987540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:11.988209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:11.988520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:11.989910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:11.997887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 40/78] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:11.998676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.048828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.080355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a3be-872f-45ef-9075-ac06602981c4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.100019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79a0a-a17d-4a66-8ae6-085377858733 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.114166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.114839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.115125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.115405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.116596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.118052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.119625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 39/79] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:12.120397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.129577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.134494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.135128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.135413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.135690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.150437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.151856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124ea6-d9e5-4bcd-987c-1fc5d7384aea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.153461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 41/80] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:11 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:12.158557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.158557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.158557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.172842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:12.174030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:12.225547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2c19-84ab-4b26-9154-da5a5fbac3e6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.240655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 42/81] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:12.241812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.261221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.261863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.262212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.262498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.263636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.265720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.267505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 40/82] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:12.269646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.288604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.344928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.363034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039510-22b5-433b-bf60-9422c214f592 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.373124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40718d-d369-49ae-a5b1-cdb01665c095 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.398133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.398766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.399046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.399322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.400691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.401907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.403656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 43/83] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:12.404212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.410434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.411308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.411799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.412697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.486884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.488749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.506332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77ad7f-a3e6-451d-aec4-b1ebfbb1e8f3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.508649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.539299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.539898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.540179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.540452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.562265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.587469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 41/84] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:12.588285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.612205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.613653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.683086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466a13-fcd9-4cf2-b864-1f5149fdd8b3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.712784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 44/85] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:12.713722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.716977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.717798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.718083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.718187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.718360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.759997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.785437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.786908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.813198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f3150-97d8-42b8-a260-2a21b5baa227 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:12.846395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:12.846997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:12.847280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:12.847558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:12.882653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:12.883418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:12.916056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:12.917548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:12.920497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.955018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:12.980656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72ac8-a09e-4b4d-bae7-e83e6f86abeb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.013714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.014354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.015204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.015351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 45/87] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:13.015483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.016186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.016625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.018082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.019643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 43/88] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.020403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.116577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364a78-0557-48f5-8162-a1cdde6178b6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.116748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa946-b21e-4174-a06e-edf40a8496e3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.118986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:13.149722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.150277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.150557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.150832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.151924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.152514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.153189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.153400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.153486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.153741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.154883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.155044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 44/89] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.156293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.156948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.158559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 46/90] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.160686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.172807 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:13.260156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a7c5-7940-43c4-bf68-2c0b83dfb28e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.260592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9661de-555e-4d76-a5f8-6759679d84ab None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.294412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.295049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.295333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.295613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.296598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.296783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.297268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.297551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.297825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] PATH_INFO: `/v3/projects/58ef0bfb637745bea3f7dc459090abfa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.298237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.299053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] RBAC: Authorizing `identity:get_project(project_id=58ef0bfb637745bea3f7dc459090abfa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.299879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 47/91] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.300465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.300638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.302235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/projects/58ef0bfb637745bea3f7dc459090abfa => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.302855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.346924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:13.384105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:13.402566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a1c87-bced-4ed3-a298-825aeb8b8a9c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.406344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869ea60-7efa-4d4f-82c9-d4c40ac4504b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.435361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.435965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.436250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.437057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.437704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.439166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.439265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.439829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.440111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.440387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.441146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:13.441459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.442861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.448072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 46/93] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.448866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.461963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 48/94] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:13 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:13.463264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.581772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:13.590763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdbbc8-7da3-4035-a832-0f409f113e68 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.640399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.641052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.641506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.641789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.642533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=58ef0bfb637745bea3f7dc459090abfa, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:13.643206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.644707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.647428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed10905-e6b0-4e37-96a3-1bc3519f749a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.650926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 49/95] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=58ef0bfb637745bea3f7dc459090abfa&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.653635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:13.698434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.699366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.700117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.700843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.701939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=ceee5fe8c66c4818ace9872367307903) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:13.702419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.704718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60ad8e-3028-4053-a3ed-bb0eb83d447c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.712693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 47/96] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/role_assignments?user.id=ceee5fe8c66c4818ace9872367307903&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:13.786960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c887cf-1393-43a2-b184-964e6fafd5f2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:13.832438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:13.833243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:13.833485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:13.833767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:13.834540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:13.834852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:13.836340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23696304-c1fa-4895-88df-d43fdfa78a13 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:13.843318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 50/97] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:13 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:16.123639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674272c-0c65-4544-89d2-0aacf5f61fb0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.124778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674272c-0c65-4544-89d2-0aacf5f61fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.125291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674272c-0c65-4544-89d2-0aacf5f61fb0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.126825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 48/98] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:16.132107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f02e9-5080-4202-9445-72fcf68ca52c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.132946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f02e9-5080-4202-9445-72fcf68ca52c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.133419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f02e9-5080-4202-9445-72fcf68ca52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.158747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6e5f02e9-5080-4202-9445-72fcf68ca52c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:16.160312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6e5f02e9-5080-4202-9445-72fcf68ca52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:16.190141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:16.262888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 51/99] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:16.615605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e39c5-0bdf-4c06-82fe-66b9da219299 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.616004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e39c5-0bdf-4c06-82fe-66b9da219299 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.616187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e39c5-0bdf-4c06-82fe-66b9da219299 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.617840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 49/100] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:16.622776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52901a5-772e-4651-9857-70776431d486 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.623072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52901a5-772e-4651-9857-70776431d486 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.623354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52901a5-772e-4651-9857-70776431d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.653579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f52901a5-772e-4651-9857-70776431d486 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:16.654810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f52901a5-772e-4651-9857-70776431d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:16.739058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 52/101] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:16.820494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e39c5-0bdf-4c06-82fe-66b9da219299 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:16.830868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:16.913918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf928-8e86-463c-916e-c6fc2ad1bc97 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.914142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf928-8e86-463c-916e-c6fc2ad1bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.914501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf928-8e86-463c-916e-c6fc2ad1bc97 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.915743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 53/102] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:16.922661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d0e1-8e6c-4a89-96bd-acbfd3cca1f7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:16.923283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d0e1-8e6c-4a89-96bd-acbfd3cca1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:16.923778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d0e1-8e6c-4a89-96bd-acbfd3cca1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:16.954254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e39c5-0bdf-4c06-82fe-66b9da219299 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:16.961548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f247d0e1-8e6c-4a89-96bd-acbfd3cca1f7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:16.963056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f247d0e1-8e6c-4a89-96bd-acbfd3cca1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:17.020596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.020596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.020596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.020596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.042827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:17.061364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:17.062306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:17.063101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:17.065551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 50/103] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:17.071453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.094870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 54/104] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:17.125672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0918-5798-4080-867a-f5ef5ed6f450 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.125964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0918-5798-4080-867a-f5ef5ed6f450 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.126411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0918-5798-4080-867a-f5ef5ed6f450 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.128089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 55/105] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:17.133581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bb89f-e2be-4beb-8192-26acebb38e25 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.134496 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bb89f-e2be-4beb-8192-26acebb38e25 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.134948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bb89f-e2be-4beb-8192-26acebb38e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.167511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.181707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8b8bb89f-e2be-4beb-8192-26acebb38e25 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:17.187391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b8bb89f-e2be-4beb-8192-26acebb38e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:17.206974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.224177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c08d1-0139-4e33-9dd2-975b2a9c3130 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.279679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.281263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.282047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.282743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.283805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:17.284616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:17.286607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fa1f9-757c-43d4-8c77-3596f6c656fd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:17.292328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 56/106] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:17.293792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621508b6-f042-445a-b7e4-36263c475495 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.294245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621508b6-f042-445a-b7e4-36263c475495 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.294666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621508b6-f042-445a-b7e4-36263c475495 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.296627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 57/107] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:17.297456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621508b6-f042-445a-b7e4-36263c475495 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.304612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 51/108] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:17.306098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.306535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.306943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.346770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:17.350147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:17.465607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:17.466669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.477296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621508b6-f042-445a-b7e4-36263c475495 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.516840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.517694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.518194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.518635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.531513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:17.532441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:17.538494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:17.539551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:17.540512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:17.543928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 58/110] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:17.545145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.580923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.586564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c89d7-5109-4af3-ac3b-73da8d293f47 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.629121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.629773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.630060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.630338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.631473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:17.632935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6a46-534d-478c-a62a-5a63c6534162 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 53/111] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712094-a6ee-404a-9087-527394c75d19 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712094-a6ee-404a-9087-527394c75d19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712094-a6ee-404a-9087-527394c75d19 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 54/112] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:17.638354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712094-a6ee-404a-9087-527394c75d19 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.661884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02a99-0c77-4a5f-995a-1fb5731461ee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.696505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.697158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.697439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.697715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.708141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:17.712894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:17.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:17.714539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 59/113] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:17.715200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.746419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712094-a6ee-404a-9087-527394c75d19 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.772481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.776872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:17.781558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.782299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.782588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.782861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.783523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:17.783827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:17.785228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:17.793243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 55/114] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:17.793854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.815406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e931-b5c0-4dce-b483-87198b366649 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.848926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.849568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.849849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.850125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.851233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:17.852703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9a87a-dbfd-45dd-a7cc-f2f8b1716d8b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:17.854438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 60/115] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:17.855342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.855627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.855904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.874335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:17.875546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:17.897176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff52f7-7c9f-4aa9-81bc-c11636b4d9df None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:17.929624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:17.930248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:17.930531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:17.930809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:17.931925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:17.933387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:17.934992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 56/116] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:17.940621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.940710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 61/117] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:17.941398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:17.997371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.009026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.045465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738f580-e53e-4be2-a9f5-17ef80ad1f86 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.051126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83782fba-c7fb-4cdb-bec3-ceb86babd1d5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.081550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.082161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.082443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.082717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.083373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:18.083678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.085092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.085900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.086546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.086829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.087111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.093413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 57/118] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.094377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.102373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:18.107213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:18.108108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:18.108903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 62/119] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:18.109546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.206020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0224-a932-4526-8ed4-7f9508cc928f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.225161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.237329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786bf2-42e5-40ed-98b8-d4243050ae1d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.243591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.244223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.244506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.244817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.245919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.247364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.249053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 58/120] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.249731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.261459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.273469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.274094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.274382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.274661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.275310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.276798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.311654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 63/121] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:15:18 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:18.312599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.371238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1b14-08af-4d77-bbdf-c649401ac404 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.409654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.410368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.410651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.410928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.413025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, user_id=6fe0e2991c7c4d1ab242aeb7bff85053, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.414510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.428860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 59/122] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:18 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:18.429716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.447228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ad45d-5097-445c-b628-a8cdb9eb95b2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.493893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.495628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.496365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.496774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.497058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.500060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.502128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.503885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 64/123] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.505292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.563317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.570625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f34437-8fb5-438e-b5c9-5fed975d8304 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.616707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.617333 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.617868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.617868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.618552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:18.618856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.620335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.629696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 60/124] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.630549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.647322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741f0e-3477-440d-92df-a21428cc71ee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.689187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.690267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.690809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.691376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.704939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:18.710642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:18.711524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:18.712305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:18.715303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 65/125] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:18.716827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.736253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12965f3-c13a-4ec1-b763-d50d0b0f5136 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.745756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.771571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.772139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.772425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.772750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.773906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.775366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.777238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.777900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.839002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5ede-dd07-4522-88fc-122ba7da3bee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.841121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:18.886541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f507-ebf2-4c92-bf61-7e96e06fe8a1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:18.886798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.887621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.887975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.888326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] PATH_INFO: `/v3/projects/58ef0bfb637745bea3f7dc459090abfa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.889849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] RBAC: Authorizing `identity:get_project(project_id=58ef0bfb637745bea3f7dc459090abfa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.891499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.898100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 66/127] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/projects/58ef0bfb637745bea3f7dc459090abfa => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.899141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:18.930214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:18.931563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:18.932289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:18.932784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:18.934889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:18.937703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:18.939895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 62/128] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:18.940673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.001372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:19.027089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb31c-edd0-44eb-98c3-274003369d7e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.062512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.063122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.063471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.063728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.064401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:19.064759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.066273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.074634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 67/129] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:19.075551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.077411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f38c89-7c5f-49ff-a433-4c913e4d33cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.113330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:19.126950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.128532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.128986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.129408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/ceee5fe8c66c4818ace9872367307903/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.132542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, user_id=ceee5fe8c66c4818ace9872367307903, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.134816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.152127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 63/130] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:18 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/ceee5fe8c66c4818ace9872367307903/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:19.153545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.211017 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f3dbd-64af-457f-b118-600b37055f13 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.309743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.311064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead309-6adc-4788-959a-2fc1912ec84e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.311758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.312238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.312767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] PATH_INFO: `/v3/projects/58ef0bfb637745bea3f7dc459090abfa/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.318897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:19.322971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] RBAC: Authorizing `identity:create_grant(project_id=58ef0bfb637745bea3f7dc459090abfa, user_id=6fe0e2991c7c4d1ab242aeb7bff85053, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.326199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.356300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 68/131] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:19 2022] PUT /identity/v3/projects/58ef0bfb637745bea3f7dc459090abfa/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:19.356300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.388486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.389990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.390269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.390559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.393805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.396186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.398240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 64/132] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:19 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:19.426007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.511795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:19.523782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4eee5-f574-4ccd-9291-b2d1ca4feb31 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.573927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.574505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.574790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.575070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] PATH_INFO: `/v3/users/2206a066a6b4467d9fed2511f0e30e74` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.595100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] RBAC: Authorizing `identity:get_user(user_id=2206a066a6b4467d9fed2511f0e30e74)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.596925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.599127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 69/133] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:19 2022] GET /identity/v3/users/2206a066a6b4467d9fed2511f0e30e74 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:19.604884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:19.612109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11312d8-b0cb-4baa-8400-ed883c8a6f67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.652122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.652885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.653447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.653556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.656296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, user_id=6fe0e2991c7c4d1ab242aeb7bff85053, role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.658221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.676310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 65/134] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:19 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/6fe0e2991c7c4d1ab242aeb7bff85053/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:19.720065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9bf-d5b3-4b51-8832-90c7e9c61d92 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:19.760294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:19.761382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:19.761878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:19.762356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:19.784826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:19.839793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:19.841628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:19.960319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 70/135] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:19.968686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:20.012839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:20.099842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203772-95d8-4fff-a207-d71f48d5ba14 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:20.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:20.141850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:20.142145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:20.142462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:20.149275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:20.150730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147595e-5ddf-4312-b22d-0c1dfae7bb22 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:20.152556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 66/136] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:19 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:20.158286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:20.251399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:20.325832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960e482-f4a3-45ac-bf63-0f00873d029f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:20.374815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:20.375858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:20.376344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:20.376839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:20.377849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=2206a066a6b4467d9fed2511f0e30e74) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:20.378364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:20.380125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe5a12-0550-46d7-ad04-5fc931e0704e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:20.388886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 71/137] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:20 2022] GET /identity/v3/role_assignments?user.id=2206a066a6b4467d9fed2511f0e30e74&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:21.229409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7d985-0f11-4cbb-947a-94ed1267d12d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:21.230351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7d985-0f11-4cbb-947a-94ed1267d12d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:21.230850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7d985-0f11-4cbb-947a-94ed1267d12d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:21.232393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 67/138] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:21.237876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:21.238172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:21.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:21.259799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:21.261032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:21.314610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493187cc-9000-4b48-b402-aea6ee5e007f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:21.315231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493187cc-9000-4b48-b402-aea6ee5e007f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:21.315707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493187cc-9000-4b48-b402-aea6ee5e007f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:21.317313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 68/139] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:21.322739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:21.323318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:21.323792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:21.368650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 72/140] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:21.369164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:21.369164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:21.469075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 69/141] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:21.946437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:21.995739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:22.002963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.048239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.069616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af66fd-1c31-45e1-83b7-ad8ece670d84 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.144736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.145389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.145671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.145946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.167535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:22.173221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:22.174086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:22.174857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 73/142] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:22.190403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:22.224399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac9d5-ac01-449e-8cd2-90b84c958e7a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.286366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.287132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.287308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.288093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.293292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:22.294761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:22.296950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 70/143] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:22.303364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:22.409258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa124cd-92a8-4758-be91-2396f94bf1b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.413616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.466252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.466887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.467169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.467967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.468675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:22.468976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:22.470343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:22.479676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 74/144] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:22.486238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:22.516026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.522017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b6ba-4fc2-41e6-b3fd-dd7461de15ad None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.568940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.570308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.570827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.571583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.572461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:22.574169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06eb26-432a-4b83-a0d4-ee37ed2dc178 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:22.613021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 71/145] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:22 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:22.614747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d4b6-62e4-4fee-aaac-67ce08360fdc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.618140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d4b6-62e4-4fee-aaac-67ce08360fdc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.618731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083d4b6-62e4-4fee-aaac-67ce08360fdc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.620555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 72/146] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:22.646609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.647248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.647941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.679315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:22.681219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:22.693909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d22f1-9786-4ac4-9e9f-55bbf1fd0699 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.766465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.767116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.767457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.767741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.772531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:22.774120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e75f5-33e0-4ca0-9258-ceacaa7d92d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:22.775832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 75/147] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:22 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:22.777103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958bb67-d42b-4e6a-8cee-de1c964a083c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.777397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958bb67-d42b-4e6a-8cee-de1c964a083c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.777672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958bb67-d42b-4e6a-8cee-de1c964a083c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.779156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 76/148] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:22.781853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 73/149] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:22.790112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:22.790495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a614f-22d8-43d5-a687-3e1e51440505 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.790792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a614f-22d8-43d5-a687-3e1e51440505 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.791072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a614f-22d8-43d5-a687-3e1e51440505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:22.831483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b62a614f-22d8-43d5-a687-3e1e51440505 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:22.836594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b62a614f-22d8-43d5-a687-3e1e51440505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:22.901864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.913608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:22.937526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45c83f-15a1-41da-9382-2ae07ca6b148 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:22.961023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 77/150] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:22.981503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:22.982459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:22.982975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:22.983446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.026453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99bd8-a021-4581-9856-54816388d316 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.026747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99bd8-a021-4581-9856-54816388d316 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.026992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99bd8-a021-4581-9856-54816388d316 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.028323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 78/151] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:23.033599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.033889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.034164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.060978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:23.063000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:23.066689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:23.067303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:23.191183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 79/152] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:23.193363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.207814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.245553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 74/153] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:23.254608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.314959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.326235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd8ca-9fe3-42b2-a2c7-01c8b6d4fa6a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.380439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.381453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.381933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.382429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.397388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:23.402809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:23.403713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:23.404493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:23.405160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766af910-66dc-42be-8eca-209eb11e57f4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.406151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 80/154] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:23.406692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.454106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.454676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.454963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.455237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.456397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:23.457963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:23.459866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 75/155] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:23.463548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.534946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.541294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593984-ab28-4ff1-9eff-34afddb62756 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.584720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.586127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.586836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.587291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.595704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52c16-652a-48db-baf2-7eaae655c79a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.600767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:23.605971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:23.606877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:23.608418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:23.610739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 81/156] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:23.612009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.639654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.640405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.640702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.640805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.641113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.642708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:23.642708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:23.644386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:23.657777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 76/157] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:23.658789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.757068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eca97-fd98-4dfb-ac50-43e55b8bc545 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.775566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e89f2a-ed5b-41d1-9490-ec3650e5d012 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.790536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.802157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.803664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.804102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.804518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.805505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:23.805826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:23.807273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:23.813328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.813975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.814256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.814443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 82/158] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:23.814540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.815267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.846695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:23.853382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:23.854443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:23.855249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 77/159] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:23.855896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:23.918657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:23.944154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f241-e8aa-427f-8115-1a257ec73093 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.983663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:23.984422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed1ed-ec4a-479c-9e4e-b498a0f8e084 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:23.984967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:23.985439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:23.985901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:23.986777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:23.987289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:23.988913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d47512-7951-4c22-99df-ab750184d9ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:23.999735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 83/160] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:24.001405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856110-a222-4625-83a2-308522d7ae7a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.001898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856110-a222-4625-83a2-308522d7ae7a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.002364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856110-a222-4625-83a2-308522d7ae7a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.004628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 84/161] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:24.005636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856110-a222-4625-83a2-308522d7ae7a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.038077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.038739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.039021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.039301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.041605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.043581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962fc5-a475-4681-b4cb-e7b61d775722 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.046144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 78/162] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:23 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:24.047245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.047530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.047807 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.073538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:24.074761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:24.120634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:24.152983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856110-a222-4625-83a2-308522d7ae7a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:24.162750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 79/163] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:24.163711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.207287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.208269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.208878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.209318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.210150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:24.210597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.212320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.227867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 85/164] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:24.228977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.232489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:24.389626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8cbe2-b28e-4cae-bb00-6504237eb7d5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:24.395087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1228e7-a87a-4e6d-8748-c30e503e157e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:24.437168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.437934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.438292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.438635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] PATH_INFO: `/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.440787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe0e2991c7c4d1ab242aeb7bff85053)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.441620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.442234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.442695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.443161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.443615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.443800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 80/165] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/users/6fe0e2991c7c4d1ab242aeb7bff85053 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:24.444559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.522905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:24.546622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.548242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.550566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:24.664241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 86/166] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:24.665572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.706496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746b1b-d278-4e7e-bf75-6e2f6b779115 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:24.770724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7fb9-9abd-4a82-b4bb-02edb396dd62 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:24.773293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:24.785381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.786044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.786326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.786631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] PATH_INFO: `/v3/users/ceee5fe8c66c4818ace9872367307903` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.787786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] RBAC: Authorizing `identity:get_user(user_id=ceee5fe8c66c4818ace9872367307903)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.789434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.791129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 81/167] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/users/ceee5fe8c66c4818ace9872367307903 => generated 247 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:24.792892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.806325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:24.807006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:24.807294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:24.807567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:24.879371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:24.881009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:24.988422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 87/168] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:24.989303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:24.999163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6785b3-86b2-40bb-93bf-9ef96633f890 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.000309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.018772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.071142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.071785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.072066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.072340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.098462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:25.108910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:25.110006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:25.111021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:25.113435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 82/169] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:25.114373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.135270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e2d48-9972-4930-9619-338f88b2da83 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.211777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.212415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.212722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.212996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] PATH_INFO: `/v3/projects/58ef0bfb637745bea3f7dc459090abfa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.214975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] RBAC: Authorizing `identity:get_project(project_id=58ef0bfb637745bea3f7dc459090abfa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.216406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.218106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 88/170] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:24 2022] GET /identity/v3/projects/58ef0bfb637745bea3f7dc459090abfa => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.218867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.283345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a748-387f-4e5a-815d-252d34ed4e55 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.320904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.351677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.352291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.352580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.352856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.372895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169ad3-132d-4b52-aa3d-719f86d62abd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.398030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.431899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.433429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.493913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.494852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.495282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.501132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.502534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.504149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.505999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 89/171] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.506913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.540951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 83/172] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:25.541769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.621699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.644915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d79f2-70ec-43ff-94f0-ee9ee7f1cc16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.682724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.683333 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.683612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.683885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.684647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=58ef0bfb637745bea3f7dc459090abfa, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:25.684965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.686927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.692751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 84/173] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=58ef0bfb637745bea3f7dc459090abfa&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.693545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.698855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458bef6-91ae-42a2-b8b7-a06f44692fd5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.760896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.761516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.761847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.762122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.762786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:25.763141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.764677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.770488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.774672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 90/174] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.775473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.819197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3bcae-c473-4c7a-a5bc-5031281ac43a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.882260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8bf4-b73c-4d6e-bccb-cbecd59b2024 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:25.883359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:25.891939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.892713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.893007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.893289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.894130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=6fe0e2991c7c4d1ab242aeb7bff85053) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:25.894493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.895963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.910857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 85/175] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/role_assignments?user.id=6fe0e2991c7c4d1ab242aeb7bff85053&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.911695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:25.918656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:25.919327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:25.919653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:25.919930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:25.925934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:25.927516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:25.929531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 91/176] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:25.938613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:26.055946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:26.107199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73ce3-9c22-4bdb-9fc5-a6b0c9d9104e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:26.126799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726f69-a675-44e5-8ca0-4949607766bd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:26.166047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:26.166686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.167019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.167301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.168072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=ceee5fe8c66c4818ace9872367307903) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:26.168394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:26.169881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:26.176347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 92/177] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/role_assignments?user.id=ceee5fe8c66c4818ace9872367307903&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:26.204809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:26.205792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.206255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.206694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] PATH_INFO: `/v3/users/2206a066a6b4467d9fed2511f0e30e74` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.208288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2206a066a6b4467d9fed2511f0e30e74)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:26.210102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e70841-94d2-421c-81af-b21312d0b4f6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:26.212134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 86/178] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:25 2022] GET /identity/v3/users/2206a066a6b4467d9fed2511f0e30e74 => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:26.218745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:26.352450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a514-6c96-4469-9cd2-30ec93e75c9a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.353014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a514-6c96-4469-9cd2-30ec93e75c9a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.353442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a514-6c96-4469-9cd2-30ec93e75c9a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.354965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 87/179] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:26.367692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e0a3a-9612-4414-a615-9d97565a52de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:26.374319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.374829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.375251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.405571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:26.407084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:26.421274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:26.432352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:26.433789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.434254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.434755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.438908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:26.440666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:26.443028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 93/180] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:26 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:26.449795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:26.500943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:26.513417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 88/181] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:26.585615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50dfe9-27e4-4403-9b9b-979d23786914 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:26.625323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:26.625928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.626208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.626485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/2206a066a6b4467d9fed2511f0e30e74/roles/d7a9ba1e31cc4e51981bfdc9cd456409` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.628688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, user_id=2206a066a6b4467d9fed2511f0e30e74, role_id=d7a9ba1e31cc4e51981bfdc9cd456409)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:26.630455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6255c9-e9bd-4fc2-bfae-8dd0c4faa4f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:26.645246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 94/182] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:26 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/users/2206a066a6b4467d9fed2511f0e30e74/roles/d7a9ba1e31cc4e51981bfdc9cd456409 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:15:26.795188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:26.821714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dc1a9-40ce-4940-bcd9-cd604f99b550 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.822236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dc1a9-40ce-4940-bcd9-cd604f99b550 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.822236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dc1a9-40ce-4940-bcd9-cd604f99b550 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.823623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 95/183] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:26.829455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df95b-5c48-4a93-b5ea-453ab630299d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.829663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df95b-5c48-4a93-b5ea-453ab630299d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.829872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df95b-5c48-4a93-b5ea-453ab630299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.849382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-844df95b-5c48-4a93-b5ea-453ab630299d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:26.850569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-844df95b-5c48-4a93-b5ea-453ab630299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:26.915769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:26.919776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45f92d-fe10-4370-89f6-b73e876b7f8a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:26.929647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 96/184] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:26.930996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7327-cc72-4610-a700-4b43964d44e7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.931277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7327-cc72-4610-a700-4b43964d44e7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.931551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7327-cc72-4610-a700-4b43964d44e7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.936866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 97/185] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:26.943083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.943445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.943794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.964455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:26.966051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:26.966831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:26.968272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:26.968929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:26.969411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:26.983690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:26.988902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:26.989837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:26.995435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 89/186] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:27.001106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.053627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 98/187] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:27.068146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.120489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50292210-8427-4614-9ffd-cfdde9f8bd91 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.155976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.156937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.157374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.157802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.158601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:27.159056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.160629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.174154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 90/188] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:27.175678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.217444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.299510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f3c1-e6ea-44f8-b22a-853bc9bb2897 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.327082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.329256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa12c-b1eb-48df-a983-9175a9c7c3dc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.345165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.345801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.346240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.346371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.346521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.362392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.363905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.365483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.370054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 99/189] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:27.370054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.370249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.370249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.370249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.385377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:27.390760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:27.391822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 91/190] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:27.392835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.482118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47491d-7b15-4921-9814-8b3706b28b2e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.504517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d53110-e37d-4527-b289-92e2b038c424 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.520797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.521432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.521702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.521968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.523061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.524486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.526240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 100/191] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:27.529861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.539842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.540456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.540770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.541101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.579288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.594190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.619027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.620489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.638522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c21fc3-7ec4-43b0-bf41-124ef05c3368 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.675319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.676087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.676367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.676685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.677524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:27.678112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.679610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.688534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 101/192] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:27.693347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.736107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 92/193] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:27.741470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.790869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca900-3fbe-4321-a17a-5995ea1a4d16 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.800182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.822158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:27.829654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.830561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.830848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.831125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.831816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.833750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.845244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130e127-6322-4db9-98fc-b85aedc8ee09 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:27.864589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 102/194] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:27 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:27.864589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:27.892928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:27.893647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:27.893930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:27.894228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:27.895641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:27.897143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:27.898844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 93/195] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:27.904462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:28.016925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae091-444f-48bc-8ba5-c77f21238cea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:28.037207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b58ad3-bcec-460b-98c0-b86791450892 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:28.067773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:28.068939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:28.069443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:28.069716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:28.071726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:28.073166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:28.075197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 103/196] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:28.077623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:28.078242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:28.078522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:28.078793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:28.084551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:28.097746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:28.126942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:28.178422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:28.181802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:28.204829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e385-8c7a-45cf-a1e3-450d7e7df188 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:28.247873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:28.248683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:28.248973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:28.249244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:28.250478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=b96bc428b4f24b24a816670fba12564f) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:28.250787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:28.252522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:28.260511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 104/197] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:28 2022] GET /identity/v3/role_assignments?user.id=b96bc428b4f24b24a816670fba12564f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:28.307830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 94/198] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:28.314615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:28.423413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:28.429676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4766-31e8-4715-9937-aac4e0c4e36e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:28.466975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:28.468165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:28.468453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:28.468765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:28.469919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:28.471360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298652a-60e3-4702-b3e8-2f236ea9bd00 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:28.477729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 105/199] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:28 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:28.479481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:28.532148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:28.590679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b968da5-4a2a-4ecf-915f-9b095d9f2be2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:28.632235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:28.632981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:28.633268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:28.633548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:28.634288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=b96bc428b4f24b24a816670fba12564f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:28.634599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:28.636271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2a193-e6e7-406a-bd24-86a44286696d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:28.642489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 95/200] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:28 2022] GET /identity/v3/role_assignments?user.id=b96bc428b4f24b24a816670fba12564f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:29.032064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520791-e6ad-41ad-9b7f-03148de1baa3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:29.033110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520791-e6ad-41ad-9b7f-03148de1baa3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:29.033613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520791-e6ad-41ad-9b7f-03148de1baa3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:29.035154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 106/201] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:29.040475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:29.041349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:29.041831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:29.061599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:29.063081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:29.152305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 96/202] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:29.551574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520791-e6ad-41ad-9b7f-03148de1baa3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:29.674210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520791-e6ad-41ad-9b7f-03148de1baa3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:29.720169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:29.721206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:29.721696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:29.722160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:29.745915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:29.752151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:29.753088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:29.753883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:29.756106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 107/203] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:29.763930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:29.817442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:29.888200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc104d-1ea9-4cc8-b28e-9993d67039c8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:29.939090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:29.940068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:29.940558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:29.941041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:29.941900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:29.942391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:29.943953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:29.954951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 97/204] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:29.960813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:29.988888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:30.066984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8db6e-9a2e-4d6c-ae1c-5f963140ebab None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:30.102855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:30.103821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.104293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.104787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] PATH_INFO: `/v3/users/2206a066a6b4467d9fed2511f0e30e74` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:30.106127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] RBAC: Authorizing `identity:get_user(user_id=2206a066a6b4467d9fed2511f0e30e74)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:30.107797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:30.109643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 108/205] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:29 2022] GET /identity/v3/users/2206a066a6b4467d9fed2511f0e30e74 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:30.117621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:30.240502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:30.247314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97313eed-5b7a-408d-9d36-3c5aa4cf9278 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:30.282840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:30.283446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.283727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.283997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:30.364179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:30.366006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:30.505266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:30.509466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 98/206] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:30.515848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:30.643203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5eaf8-8d88-4be6-bc43-1c21ca8b89e5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:30.644684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:30.692063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:30.692725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.693010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.693281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:30.694414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:30.695856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5d44-76bc-4208-a326-4e4717992e6a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:30.697803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 109/207] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:30 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:30.703543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:30.850605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289264-61c0-4a27-a396-9cf01c04ebb8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:30.898806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:30.899331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.899609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.899878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:30.900626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130, user.id=2206a066a6b4467d9fed2511f0e30e74) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:30.900936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:30.902387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd580bf-3398-4d74-bafd-8e3ef946ce4b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:30.908896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 99/208] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:30 2022] GET /identity/v3/role_assignments?user.id=2206a066a6b4467d9fed2511f0e30e74&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:30.983240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811bec-1db4-4e2c-b638-21d21b4ef199 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.983571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811bec-1db4-4e2c-b638-21d21b4ef199 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.983791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811bec-1db4-4e2c-b638-21d21b4ef199 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:30.985500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 110/209] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:30.991404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6626-ff49-4bc1-b4f4-9b86a044f53d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:30.991688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6626-ff49-4bc1-b4f4-9b86a044f53d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:30.991963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6626-ff49-4bc1-b4f4-9b86a044f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.017771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e20e6626-ff49-4bc1-b4f4-9b86a044f53d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:31.019424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e20e6626-ff49-4bc1-b4f4-9b86a044f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:31.115694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:31.129584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 100/210] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:31.178589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967076f-6e4f-4299-a5b5-7ef4a4c2b748 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.178589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967076f-6e4f-4299-a5b5-7ef4a4c2b748 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.179137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967076f-6e4f-4299-a5b5-7ef4a4c2b748 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.180385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 111/211] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:31.188784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cca20-3e04-406c-a447-244e4d54f8cc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.189234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cca20-3e04-406c-a447-244e4d54f8cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.189658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cca20-3e04-406c-a447-244e4d54f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.214182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9a0cca20-3e04-406c-a447-244e4d54f8cc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:31.215610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a0cca20-3e04-406c-a447-244e4d54f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:31.262456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f2a-9445-46e1-a765-69078e6aa908 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.262775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f2a-9445-46e1-a765-69078e6aa908 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.263024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd0f2a-9445-46e1-a765-69078e6aa908 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.265200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 112/212] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:31.278742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.279026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.279299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.298030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 101/213] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:31.299651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa76f8-6f29-4480-8b83-370b23e6c302 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.300117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa76f8-6f29-4480-8b83-370b23e6c302 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.300600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa76f8-6f29-4480-8b83-370b23e6c302 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.302036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 102/214] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:31.307213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:31.307898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.308380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.308485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:31.308956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.328523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:31.330958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:31.388749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 113/215] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:31.418690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 103/216] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:31.424627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.521280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:31.531245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18a5fd-44b7-408d-ab96-58b9fa07d2c3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:31.566092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:31.567154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.567652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.568182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.578817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:31.584000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:31.584872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:31.585680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:31.588316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 114/217] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:31.595284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.595403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.666496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:31.707227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249aab6-82d5-4f85-9c52-92b65a10cbe6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:31.721623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e48013-0fc9-4915-b9f6-8fee934bdeea None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:31.741371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:31.741999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.742275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.742544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.743630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:31.745103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:31.746636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 115/218] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:31.750881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.755618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:31.756226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.756508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.756816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.757765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:31.758078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:31.759430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:31.768192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 104/219] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:31.769185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.773757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:31.848345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d63e-fe51-476d-a4cf-f3528c427117 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:31.865635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c2943-f869-42fc-8f6a-c855c9937b05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:31.881671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:31.882518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:31.883036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.883315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.883588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.893615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:31.898389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:31.899341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:31.900118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:31.900755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:31.900842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 116/220] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:31.900934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:31.901000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.901064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:31.901064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:31.910578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:31.915830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:31.916931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 105/221] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:31.917849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:31.982400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.004952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d56d-2b57-481f-90ed-623533dd03f3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.015202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474f3ee-2c67-4f15-bd5e-57ba2c80f71a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.037743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.038285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.038560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.038831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.039464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.040910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.047605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.048226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.048505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.048812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] PATH_INFO: `/v3/users/81af53e65f0045f8ac494f5d69e18f0f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.063425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 117/222] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:31 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:32.064233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.071022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] RBAC: Authorizing `identity:get_user(user_id=81af53e65f0045f8ac494f5d69e18f0f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.072750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.074499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 106/223] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:31 2022] GET /identity/v3/users/81af53e65f0045f8ac494f5d69e18f0f => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.075321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.121744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.197187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817728-8e59-4169-be0e-e4a18c15379f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.204237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c253c-506d-4be6-9816-f30da0993318 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.233548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.234170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.234457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.234732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.235404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:32.235736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.237107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.245552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.245940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 107/224] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.246914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.247437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.247727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.248008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.249538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:32.249538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.250542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.252945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.265468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 118/225] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.265786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.372443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.381490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc1c9-1ee4-4a11-aef0-a840735b2ddc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.384335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ea65-c956-4e15-80cb-96aea825f068 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.421029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.422030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.422505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.422966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.427898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.428616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.428939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.429218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.430384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.431834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.433784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 119/226] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.434777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.504169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.506424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.506629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.549579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82ddd-127c-4827-bebe-80013209aa47 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.603128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.603780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.604061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.604364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.606267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.608531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.611116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 120/227] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.611892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.620555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.629229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 108/228] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:32.630490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.734083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136323-91b5-4508-8632-c318acf3ce4e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.751585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7cff2-3090-4970-8e2d-8bed149ac07d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.765919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.773027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.773927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.774426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.774889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.776210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.777868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.779789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 121/229] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.780858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.797530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.798184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.798466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.798740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.800139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.802137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.803932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 109/230] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.804504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.870926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:32.911879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb91c08-78a8-4415-90fb-0731d5caaf85 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.913533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a155-50f4-44b7-ae95-61b020f43d06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:32.956982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.957760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.958039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.958317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/users/b96bc428b4f24b24a816670fba12564f/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.959355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:32.960094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:32.960356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, user_id=b96bc428b4f24b24a816670fba12564f, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.960456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:32.960663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:32.961792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:32.961972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.963206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:32.964937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 122/231] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:32.965679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:32.989647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 110/232] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:32 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/users/b96bc428b4f24b24a816670fba12564f/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:32.990923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:33.061622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:33.115661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413669a-89ed-498e-9bf3-ca2198c5e87a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:33.161420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:33.162161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:33.162380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:33.162649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/users/b96bc428b4f24b24a816670fba12564f/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:33.166189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, user_id=b96bc428b4f24b24a816670fba12564f, role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:33.168535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaac2d-b689-42a9-b335-b24df26188aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:33.173700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dde9d-381e-4921-a4c9-b63abd9cf663 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:33.215364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 123/233] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:32 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/users/b96bc428b4f24b24a816670fba12564f/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:33.230900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:33.246084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:33.246740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:33.247022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:33.247425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:33.249744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=81af53e65f0045f8ac494f5d69e18f0f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:33.250089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:33.251618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906fa1-e237-42bd-957e-1da78b81ab28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:33.258133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 111/234] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:32 2022] GET /identity/v3/role_assignments?user.id=81af53e65f0045f8ac494f5d69e18f0f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:34.627262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2944-cb9a-4d0a-a66b-db405c8c4763 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:34.628306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2944-cb9a-4d0a-a66b-db405c8c4763 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:34.628822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2944-cb9a-4d0a-a66b-db405c8c4763 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:34.631047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 124/235] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:34.639093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a581-e516-46de-8654-373ddf4a6f52 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:34.640122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a581-e516-46de-8654-373ddf4a6f52 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:34.640616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a581-e516-46de-8654-373ddf4a6f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:34.661782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f8e3a581-e516-46de-8654-373ddf4a6f52 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:34.663351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8e3a581-e516-46de-8654-373ddf4a6f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:34.733922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 112/236] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:34.878462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33109492-38eb-46c1-a110-fa24760378b7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:34.879053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33109492-38eb-46c1-a110-fa24760378b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:34.879536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33109492-38eb-46c1-a110-fa24760378b7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:34.881101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 125/237] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:34.886229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:34.886722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:34.887188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:34.913511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:34.915006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:34.998502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 113/238] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:35.094480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33109492-38eb-46c1-a110-fa24760378b7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.217809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33109492-38eb-46c1-a110-fa24760378b7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.245091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:35.254358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.254981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.255257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.255533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.266969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:35.271770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:35.272667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:35.273464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 126/239] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:35.280536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.350670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:35.410028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5d06-8f72-46d5-9854-4d073fa6b868 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.422389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.456850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.457529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.457806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.458075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.458743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:35.459426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:35.460712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:35.471233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 114/240] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:35.477017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.594927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fbe-da2b-4338-899f-b5903816b9ef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.605883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790215-f643-47ea-a678-5b2148d38c5b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.606839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:35.663594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.667024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.668332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.669015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] PATH_INFO: `/v3/users/a3dc99955eb24a2aad8b6afb49e87234` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.692727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.695065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.695550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.696088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.698872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:35.700700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:35.705303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 127/241] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:35.706227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] RBAC: Authorizing `identity:get_user(user_id=a3dc99955eb24a2aad8b6afb49e87234)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:35.707969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:35.709902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 115/242] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:35 2022] GET /identity/v3/users/a3dc99955eb24a2aad8b6afb49e87234 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:35.711009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.715991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:35.830715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:35.883047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618698-dbb1-4a08-bf16-7e032a593d6a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.883732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208863be-5829-4630-a883-3a49bb4b89ce None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:35.926182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.926444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:35.926819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.926921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.927097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.927192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.927369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.927462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.928359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:35.929799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f72eca-3ed9-454a-ab6f-859b8c6e283d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:35.964674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 128/243] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:35 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:35.964674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7cda-ff6d-422b-92d0-19b8b5826fd6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.964674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7cda-ff6d-422b-92d0-19b8b5826fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.964674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7cda-ff6d-422b-92d0-19b8b5826fd6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.964674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 129/244] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:35.965828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38cd0-3cc3-4907-aaf7-6215a1ef7c2b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.966304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38cd0-3cc3-4907-aaf7-6215a1ef7c2b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.966816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38cd0-3cc3-4907-aaf7-6215a1ef7c2b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:35.968355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 130/245] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:35.975316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:35.975455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31ca9-1d06-492d-85af-bc43705d4301 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:35.975777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31ca9-1d06-492d-85af-bc43705d4301 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:35.976170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31ca9-1d06-492d-85af-bc43705d4301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.005686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d9f31ca9-1d06-492d-85af-bc43705d4301 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:36.006889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d9f31ca9-1d06-492d-85af-bc43705d4301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:36.024106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:36.026254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af044e1-b1bf-40fe-b8cc-8df803eb808b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:36.082732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 131/246] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:36.084009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601eee8-7691-4636-a94a-66c93d1d0876 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.084292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601eee8-7691-4636-a94a-66c93d1d0876 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.084583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601eee8-7691-4636-a94a-66c93d1d0876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.108749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2601eee8-7691-4636-a94a-66c93d1d0876 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:36.109953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2601eee8-7691-4636-a94a-66c93d1d0876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:36.162599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.172646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 116/247] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:36.172646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0168b-9e6e-4883-886b-faf8b2251b33 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.172646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0168b-9e6e-4883-886b-faf8b2251b33 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.172646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0168b-9e6e-4883-886b-faf8b2251b33 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.173115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 117/248] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:36.175920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0168b-9e6e-4883-886b-faf8b2251b33 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.206789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 132/249] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:36.208247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.208536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.208878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.230252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:36.231611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:36.285278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.312874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 133/250] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:36.330421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0168b-9e6e-4883-886b-faf8b2251b33 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:36.370019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:36.370764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.371046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.371370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.372498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:36.374061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:36.376063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 118/251] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:36.382102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.418713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.514891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc26ef-9b1c-4c18-a6a8-e7ad6120f912 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:36.516826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.550610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c9add-06f5-4a21-a77f-1b9af6dceb0b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:36.559720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:36.560336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.560791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.561112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.563642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=a3dc99955eb24a2aad8b6afb49e87234) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:36.563958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:36.566096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:36.572929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 134/252] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/role_assignments?user.id=a3dc99955eb24a2aad8b6afb49e87234&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:36.573592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.604149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:36.604899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.605176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.605443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.612922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.639339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:36.645366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:36.646345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:36.647586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 119/253] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:36.648462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.732824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca211e-a8bd-4f73-bc8d-fc345dcd9d06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:36.772188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465be2e-71d1-4ef5-ab7b-cbff8d65d176 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:36.780199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:36.780943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.781233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.782305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.798031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:36.806410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:36.807994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 135/254] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:36.809027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.816285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:36.817107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:36.817388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:36.817659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:36.832466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:36.837690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:36.840026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 120/255] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:36.841257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:36.846998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.935389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:36.985491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6593c-bc54-42b1-8e4f-849ca2b4656b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.008005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f843-345b-4c02-a0a6-2a844c0e51c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.049033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.049565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.049844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.050110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.050772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:37.051072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.052430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.067149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 136/256] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.067416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.068221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.068534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.068718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.068718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.069139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:37.069406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.070791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.088895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 121/257] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.089777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.216514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64343-e4c0-4d47-8f4d-813606af3aab None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.248984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:37.259447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.260310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.260779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.261409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] PATH_INFO: `/v3/users/81af53e65f0045f8ac494f5d69e18f0f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.262695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] RBAC: Authorizing `identity:get_user(user_id=81af53e65f0045f8ac494f5d69e18f0f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.265095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.267424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 122/258] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/users/81af53e65f0045f8ac494f5d69e18f0f => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.268613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.275867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:37.306523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3df46-fe3b-4378-8ac9-614d335cef9d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.390816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.391609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.391959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.392307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.393662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:37.394053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.395901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.415476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876b31-82b5-404a-8220-ad9942e9e2be None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.417936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 137/259] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.419487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.465868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.467580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.468041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.468539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.469870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.471513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.474207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 123/260] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.475424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.541440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:37.600447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114c4e7-af2a-4ebb-af80-18aab47e5afb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.647834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.648479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.648778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.649051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] PATH_INFO: `/v3/users/b96bc428b4f24b24a816670fba12564f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.653235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] RBAC: Authorizing `identity:get_user(user_id=b96bc428b4f24b24a816670fba12564f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.655201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.660297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 124/261] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/users/b96bc428b4f24b24a816670fba12564f => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.663263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.710136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af46a-8be4-48c3-90dd-046af0e3eeca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.785279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.785929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.786205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.786484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.787656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.789266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.791069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 138/262] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:37.795859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:37.821770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929219c-36ca-4761-a8de-0ae6b4bb8777 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:37.829820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:37.860292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:37.861009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:37.861298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:37.861604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:37.872963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:37.941966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:37.944301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:37.982012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571446-e60a-4953-bcb3-03d4b721cf4f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.042502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:38.043116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:38.043396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:38.043666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:38.118531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 125/263] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:38.119481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:38.145431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:38.193225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:38.194768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:38.236047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:38.278446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497f22-5dad-4ff6-a575-82dfc5e194f2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.321795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:38.322454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:38.322731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:38.322996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/users/81af53e65f0045f8ac494f5d69e18f0f/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:38.327782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, user_id=81af53e65f0045f8ac494f5d69e18f0f, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:38.329508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:38.363777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 126/264] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:38 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/users/81af53e65f0045f8ac494f5d69e18f0f/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:38.365244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:38.375252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 139/265] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:38.381953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:38.569762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ce4c-0a36-4626-9029-dfde32e53ab4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.601318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:38.629234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:38.638109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:38.639400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:38.639784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:38.644589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:38.644589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:38.644589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:38.647607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 140/266] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:38 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:38.655361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:38.663218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d43e0-1835-4b55-8039-7f566b778e80 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.720775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:38.721424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:38.721699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:38.721967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:38.724293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:38.725530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:38.727180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 127/267] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:38 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:38.734545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:38.842477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2268bdb-8bbb-40fa-a48b-12e62f7cffc0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.944697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:38.944697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:38.944697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:38.944697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:38.945077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=b96bc428b4f24b24a816670fba12564f) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:38.945077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:38.945464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed493-463a-4ac9-a302-cc9aae9aefd7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:38.959452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a974-18fe-4f3c-ac8b-979b69ba7f6e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:38.962725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 141/268] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:38 2022] GET /identity/v3/role_assignments?user.id=b96bc428b4f24b24a816670fba12564f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:39.020514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acbef-2b96-440d-bd84-fcb4e3888289 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.020849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acbef-2b96-440d-bd84-fcb4e3888289 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.021097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acbef-2b96-440d-bd84-fcb4e3888289 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.021985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:39.022554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 142/269] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:39.022657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.022877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.023153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.023892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=b96bc428b4f24b24a816670fba12564f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:39.024207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:39.025681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747981-c531-4273-8d95-a72df3b41dad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:39.033825 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06111b6-5a7e-4764-8961-fc21b32aac21 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.034127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06111b6-5a7e-4764-8961-fc21b32aac21 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.034374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06111b6-5a7e-4764-8961-fc21b32aac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.037838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 128/270] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:38 2022] GET /identity/v3/role_assignments?user.id=b96bc428b4f24b24a816670fba12564f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:39.074770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c06111b6-5a7e-4764-8961-fc21b32aac21 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:39.076084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c06111b6-5a7e-4764-8961-fc21b32aac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:39.154853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:39.190803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 143/271] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:39.193219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89543-f0b9-4ccf-b4c0-9d6a62babace None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.193511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89543-f0b9-4ccf-b4c0-9d6a62babace None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.193795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89543-f0b9-4ccf-b4c0-9d6a62babace None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.199447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 129/272] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:39.201308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea05d-997e-43a1-ade9-e5efe2802996 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.201602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea05d-997e-43a1-ade9-e5efe2802996 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.201878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea05d-997e-43a1-ade9-e5efe2802996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.236084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-402ea05d-997e-43a1-ade9-e5efe2802996 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:39.237301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-402ea05d-997e-43a1-ade9-e5efe2802996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:39.335220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 144/273] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:39.399076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8c40-5617-41c2-b5ed-50976d17f92f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.399385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8c40-5617-41c2-b5ed-50976d17f92f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.399634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8c40-5617-41c2-b5ed-50976d17f92f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.401018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 130/274] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:39.406390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.406677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.406952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.427964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:39.429169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:39.491304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8c40-5617-41c2-b5ed-50976d17f92f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:39.511660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 145/275] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:39.524449 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:39.614288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8c40-5617-41c2-b5ed-50976d17f92f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:39.652432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:39.653102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.653381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.653653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.664329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:39.671863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:39.672873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:39.673659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 131/276] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:39.679237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:39.687474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:39.726983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:39.779687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:39.806919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626586-e0e2-4db9-8d78-0fcd51869022 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:39.809363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00672620-345f-4a9e-b1af-b9b0f14b154b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:39.847860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:39.848500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.849094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.849381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.849634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:39.850241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:39.850520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:39.850789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:39.850891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:39.851461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:39.851737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:39.852256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:39.853117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:39.853996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 132/277] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:39.854688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:39.862508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 146/278] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:39.862935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:39.967902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a70a-c8d6-4238-94b4-7a4e92f82694 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:39.968699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141d0a-7454-4e5f-8de3-71b8ce525a64 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:39.969565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.003871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.004478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.004945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.005225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.006200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.007779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.010327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.011033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.011399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.011744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.023519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:40.028775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 147/279] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:15:39 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:40.029865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:40.030784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:40.032064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 133/280] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:40.037970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.039336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.043232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.165914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8ae9-6414-4e88-b5da-2509611264af None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.178673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a34cda-e68e-4ea4-b2ff-9b1b81d229f2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.216450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.216990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.217606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.217883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.218156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.218256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.218728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.218827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:40.219111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.219478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] PATH_INFO: `/v3/users/a105f11642854ef29863e27d17e4e82e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.220496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.230173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 134/281] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:40.234983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] RBAC: Authorizing `identity:get_user(user_id=a105f11642854ef29863e27d17e4e82e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.236213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.236983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.238829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 148/282] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:40 2022] GET /identity/v3/users/a105f11642854ef29863e27d17e4e82e => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:40.244546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.265490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.318224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.362085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3118489-6ec2-4b23-a420-3564cfe7f8c6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.380387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9f61-4810-4c69-8124-c98aaf8da5ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.403146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.403779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.404788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.405067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] PATH_INFO: `/v3/users/a3dc99955eb24a2aad8b6afb49e87234` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.406329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] RBAC: Authorizing `identity:get_user(user_id=a3dc99955eb24a2aad8b6afb49e87234)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.407778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.409929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 135/283] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:40 2022] GET /identity/v3/users/a3dc99955eb24a2aad8b6afb49e87234 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:40.415110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.425024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.425897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.426319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.427206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.428075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, user.id=a105f11642854ef29863e27d17e4e82e, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:40.428830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.430281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.440621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 149/284] 10.222.0.30 () {56 vars in 1308 bytes} [Fri Sep 9 06:15:40 2022] GET /identity/v3/role_assignments?user.id=a105f11642854ef29863e27d17e4e82e&scope.system=all&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:40.553159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb421-5e79-4390-8afb-c257777b3198 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.589396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.595103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.595755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.596037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.596312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.597531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.599290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19823a7b-c81b-449a-aa30-aa31c71d9eef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.601404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 136/285] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:40 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:40.608919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:40.730540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:40.754395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a05d8-e62a-4265-a8e6-7cfd3ea8a33e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:40.792269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213aff-f647-414a-90a9-20229f126072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:40.793027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213aff-f647-414a-90a9-20229f126072 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:40.793308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213aff-f647-414a-90a9-20229f126072 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:40.793579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213aff-f647-414a-90a9-20229f126072 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/users/a3dc99955eb24a2aad8b6afb49e87234/roles/d7a9ba1e31cc4e51981bfdc9cd456409` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:40.796023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213aff-f647-414a-90a9-20229f126072 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, user_id=a3dc99955eb24a2aad8b6afb49e87234, role_id=d7a9ba1e31cc4e51981bfdc9cd456409)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:40.797476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213aff-f647-414a-90a9-20229f126072 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:40.818127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 150/286] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:15:40 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/users/a3dc99955eb24a2aad8b6afb49e87234/roles/d7a9ba1e31cc4e51981bfdc9cd456409 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:41.349587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3d40-88b2-43d7-a518-265b57f2f30b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:41.350125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3d40-88b2-43d7-a518-265b57f2f30b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:41.350125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3d40-88b2-43d7-a518-265b57f2f30b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:41.351736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 137/287] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:41.356897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:41.357332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:41.357499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:41.380928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:41.382113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:41.462168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 151/288] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:41.782594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3d40-88b2-43d7-a518-265b57f2f30b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:41.933784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3d40-88b2-43d7-a518-265b57f2f30b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:41.986711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:41.987787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:41.988268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:41.988765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.006693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:42.014423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:42.015356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:42.016245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:42.023419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 138/289] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:42.025068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:42.133986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:42.192306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ad47-5946-4c1f-9300-268ee1898b7d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:42.234677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:42.235289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:42.235730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:42.236016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.236721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:42.237027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:42.238392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:42.250130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 152/290] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:42.255786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:42.352814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:42.419959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89632c0-6509-460c-afad-09feb3f07e07 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:42.465475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:42.466117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:42.466958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:42.467249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] PATH_INFO: `/v3/users/81af53e65f0045f8ac494f5d69e18f0f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.473258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=81af53e65f0045f8ac494f5d69e18f0f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:42.474992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152173f-1d8a-41a9-a28f-0ff0e0d9f0f5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:42.476919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 139/291] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:42 2022] GET /identity/v3/users/81af53e65f0045f8ac494f5d69e18f0f => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:42.482527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:42.607985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61d98-104c-438a-8ec3-567d1e7166e4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:42.643658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:42.644534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:42.644997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:42.645471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:42.645898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.744216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:42.745747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:42.873028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263c89-d053-45d3-abf9-c4ccac172d3e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:42.873028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263c89-d053-45d3-abf9-c4ccac172d3e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:42.873028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263c89-d053-45d3-abf9-c4ccac172d3e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.874704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 140/292] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:42.885466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bee0-db55-492c-b8eb-c0869ebbe6de None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:42.885753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bee0-db55-492c-b8eb-c0869ebbe6de None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:42.886034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bee0-db55-492c-b8eb-c0869ebbe6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:42.891450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 153/293] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:42.896703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:42.909607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c331bee0-db55-492c-b8eb-c0869ebbe6de None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:42.911094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c331bee0-db55-492c-b8eb-c0869ebbe6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:42.948166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.036226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 141/294] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:43.065023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a57a9-cfac-40b8-8f95-32325702075c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.119957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.122180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4af7-3b98-48aa-b7c4-6e091afc7676 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.123340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4af7-3b98-48aa-b7c4-6e091afc7676 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.123813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4af7-3b98-48aa-b7c4-6e091afc7676 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.125363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 142/295] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:43.125952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.126445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.126957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.128355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:43.130065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:43.130559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590884-6ab2-4076-b668-5ebd617b1657 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.131013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590884-6ab2-4076-b668-5ebd617b1657 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.131437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72590884-6ab2-4076-b668-5ebd617b1657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.132594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 154/296] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:42 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:43.138873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.163441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-72590884-6ab2-4076-b668-5ebd617b1657 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:43.165887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-72590884-6ab2-4076-b668-5ebd617b1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:43.233717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.249523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 143/297] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:43.250975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e16e0-05a3-4286-a6bb-69e8b5813b00 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.251414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e16e0-05a3-4286-a6bb-69e8b5813b00 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.251879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e16e0-05a3-4286-a6bb-69e8b5813b00 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.257382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 144/298] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:43.262595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.264271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.264738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.297340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:43.300028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:43.302881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.309136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d874-8a5a-4af5-bb78-c5b7e4a9b653 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.356723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.357876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.358581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.359027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.359900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=81af53e65f0045f8ac494f5d69e18f0f) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:43.360740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:43.362919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:43.369883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 155/299] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/role_assignments?user.id=81af53e65f0045f8ac494f5d69e18f0f&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:43.370849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.395246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 145/300] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:43.490172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4151ca-53bd-47b2-8f8d-f6dd01aa61d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.537357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.538269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.538698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.539197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.557946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:43.563228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:43.564320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:43.565352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:43.567578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 156/301] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:43.573821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.574040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.606563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.728525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6c40-eadb-4b47-854f-fd6a3ceaf1d7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.738522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bb6b6-d73e-4a50-bb98-acb0defb4cec None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.760948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.776102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.776811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.777098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.777374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.778048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:43.779283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:43.780271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:43.785211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.786568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.787336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.787615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.793452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 157/302] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:43.793623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:43.793706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.793778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:43.796637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 146/303] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:43.797863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.886951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:43.901750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53131cd-3483-4fee-b12b-fc209ca0fe49 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.901883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608065d-08e3-45b0-9c1d-7a068bf100c1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:43.934999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.935196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:43.935628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.935727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.935905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.935992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.936178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.936264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] PATH_INFO: `/v3/users/85d533098ae3466b8d572092dce271eb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.946023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:43.949679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] RBAC: Authorizing `identity:get_user(user_id=85d533098ae3466b8d572092dce271eb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:43.951665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20931ab1-901a-4f60-9336-d028a2f00a9d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:43.952171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:43.953129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:43.953921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 158/304] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:43.954559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 147/305] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/users/85d533098ae3466b8d572092dce271eb => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:43.956020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:43.956515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b860bb-b9fa-4545-b057-f457fdcb13ad None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:43.956902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b860bb-b9fa-4545-b057-f457fdcb13ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:43.957244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b860bb-b9fa-4545-b057-f457fdcb13ad None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:43.958661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 148/306] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:43.959410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b860bb-b9fa-4545-b057-f457fdcb13ad None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.006637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.057025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd87a-0a30-4556-a3f0-4fec9c918b28 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.060573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b860bb-b9fa-4545-b057-f457fdcb13ad None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.089377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.089978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.090255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.090526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] PATH_INFO: `/v3/groups` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.091189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.093170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454bf1-b0b6-472e-82d9-9d5f19898760 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.093774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.094369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.094647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.094916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.095574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:44.095877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.097279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.107000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 149/307] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:44.109427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 159/308] 10.222.0.30 () {60 vars in 1134 bytes} [Fri Sep 9 06:15:43 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:15:44.109567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.110845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.111133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.111456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.132956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.140504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:44.141667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:44.232669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 160/309] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:44.233732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.238031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7336-a427-4281-a688-ab0ab546409b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.252246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.284159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.285247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.285727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.286203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.287173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, user.id=85d533098ae3466b8d572092dce271eb, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:44.287676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.289345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.295620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 150/310] 10.222.0.30 () {56 vars in 1308 bytes} [Fri Sep 9 06:15:44 2022] GET /identity/v3/role_assignments?user.id=85d533098ae3466b8d572092dce271eb&scope.system=all&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:44.369489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b988-1c6e-4e1d-8f8c-f4ae329d3c7c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.412426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.413023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.413301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.413571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] PATH_INFO: `/v3/users/a105f11642854ef29863e27d17e4e82e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.414786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=a105f11642854ef29863e27d17e4e82e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.416297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.418151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 161/311] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:44 2022] GET /identity/v3/users/a105f11642854ef29863e27d17e4e82e => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:44.424378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.513046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.517292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.537219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd562e26-4dc6-46e4-9866-6d520e3b4d99 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.574308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.575339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.576358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.576918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] PATH_INFO: `/v3/system/users/a105f11642854ef29863e27d17e4e82e/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.578646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a105f11642854ef29863e27d17e4e82e, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.580287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.594209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 151/312] 10.222.0.30 () {58 vars in 1334 bytes} [Fri Sep 9 06:15:44 2022] PUT /identity/v3/system/users/a105f11642854ef29863e27d17e4e82e/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:44.639882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73465d-4a43-49c4-a31b-af0c3073e6f1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.678094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.678664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.679013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.679294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.691893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:44.697493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:44.698424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:44.699236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 162/313] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:44.705225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.745393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.817969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58316-11ee-4983-9806-3525154ba9f1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:44.853933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:44.854915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:44.855388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:44.855875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:44.857298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:44.857796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:44.859366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:44.868483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 152/314] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:44.874057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:44.950436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:44.995208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ea0cc-0d42-44e2-995e-7b722ab76cfa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:45.031438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:45.032315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:45.032800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:45.033245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] PATH_INFO: `/v3/users/a3dc99955eb24a2aad8b6afb49e87234` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:45.034575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] RBAC: Authorizing `identity:get_user(user_id=a3dc99955eb24a2aad8b6afb49e87234)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:45.036146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:45.038240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 163/315] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:44 2022] GET /identity/v3/users/a3dc99955eb24a2aad8b6afb49e87234 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:45.048620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:45.144931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:45.152559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559c7b0-5cd0-4d1b-8299-61fff2ae66e3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:45.188105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:45.188933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:45.189672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:45.189672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:45.270124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:45.271972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:45.370284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:45.377876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 153/316] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:45.386300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:45.494154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d1fd-3d85-47d6-b1e7-bbeb9ec8b1ec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:45.525207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:45.532273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:45.533158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:45.533610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:45.534037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:45.535329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:45.536941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e224a9-2f40-4281-8523-58426f0c29c1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:45.539094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 164/317] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:45 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:45.545732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:45.657098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ff8f-0550-48c2-823b-ee3956a75ffc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:45.695945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:45.696814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:45.697238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:45.697683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:45.698545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, scope.project.id=dca469b42ca84e9eac97aec680481833, user.id=a3dc99955eb24a2aad8b6afb49e87234) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:45.698996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:45.700679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c60c5-2899-4fae-809c-fbdd5f670c5a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:45.707079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 154/318] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:15:45 2022] GET /identity/v3/role_assignments?user.id=a3dc99955eb24a2aad8b6afb49e87234&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:46.490057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eec72-fc8e-487c-b8f4-59ffaf593f06 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.490458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eec72-fc8e-487c-b8f4-59ffaf593f06 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.490627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eec72-fc8e-487c-b8f4-59ffaf593f06 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.492001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 165/319] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:46.498611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c80e27-153f-4d5e-88c1-ae44658af645 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.498902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c80e27-153f-4d5e-88c1-ae44658af645 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.499164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c80e27-153f-4d5e-88c1-ae44658af645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.518883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-08c80e27-153f-4d5e-88c1-ae44658af645 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:46.520096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08c80e27-153f-4d5e-88c1-ae44658af645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:46.577772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:46.590055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 155/320] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:46.605309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f729-8f17-4afd-aca7-f547ba23fe3a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.605771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f729-8f17-4afd-aca7-f547ba23fe3a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.605845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f729-8f17-4afd-aca7-f547ba23fe3a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.607569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 166/321] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:46.612981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b766b7-7485-43df-ae51-903c2a0a8c8a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.613274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b766b7-7485-43df-ae51-903c2a0a8c8a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.613549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b766b7-7485-43df-ae51-903c2a0a8c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.633397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a7b766b7-7485-43df-ae51-903c2a0a8c8a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:46.634627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7b766b7-7485-43df-ae51-903c2a0a8c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:46.705784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 156/322] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:46.746528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f6348-611e-45ed-b73e-6bd31c982663 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.746733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f6348-611e-45ed-b73e-6bd31c982663 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.747390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f6348-611e-45ed-b73e-6bd31c982663 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.748829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 167/323] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:46.754015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.754302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.754571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.772389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:46.773589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:46.839450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 157/324] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:46.857587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f6348-611e-45ed-b73e-6bd31c982663 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:46.962440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f6348-611e-45ed-b73e-6bd31c982663 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:46.977362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:46.995859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:46.996493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:46.996860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:46.997120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:46.998209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:46.999644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.001316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 168/325] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:47.006562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.029746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.078231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.081372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7c70-4f62-4296-93e2-efefe377ee3d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.115953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.116606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.116889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.117159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.118344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1a1c-c828-4770-86f1-e766b89dbc00 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.127026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:47.131900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:47.133000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 158/326] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:47.134274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.156128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.156763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.157045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.157319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] PATH_INFO: `/v3/groups` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.157949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.159372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.174744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 169/327] 10.222.0.30 () {60 vars in 1134 bytes} [Fri Sep 9 06:15:47 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:15:47.175416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.257645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af699c43-22a4-41ac-abe9-584916c398d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.271306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.292886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365f0b-6ba4-4b86-8a70-1cc2f39e911f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.298998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.299646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.299926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.300196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.312313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:47.317453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:47.318422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:47.319215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 159/328] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:47.324505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.330918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.341926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.342538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.342817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.343087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.343776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:47.344080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.345481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.354329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 170/329] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:47.360124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.454422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d717f9-9151-4f2f-b7d7-aa618bdf4209 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.482508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1fe7-7a96-45a6-89da-22a6f514dde2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.497468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.498465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.498745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.499019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.499695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:47.500001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.501408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.512090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 160/330] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:47.518548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.526428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.527074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.527358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.527644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] PATH_INFO: `/v3/users/85d533098ae3466b8d572092dce271eb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.529339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] RBAC: Authorizing `identity:get_user(user_id=85d533098ae3466b8d572092dce271eb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.530767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.532639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 171/331] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/users/85d533098ae3466b8d572092dce271eb => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:47.538098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.561130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.620544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.663386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2e49-4d5f-4254-9647-898151fd6fcb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.680481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cab520-5ac1-478c-9779-0ce7ef3a7c93 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.705117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.706459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.706893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.707444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] PATH_INFO: `/v3/users/a105f11642854ef29863e27d17e4e82e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.709088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] RBAC: Authorizing `identity:get_user(user_id=a105f11642854ef29863e27d17e4e82e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.711297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.713618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 161/332] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/users/a105f11642854ef29863e27d17e4e82e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:47.720821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:47.728715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.729438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.729719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.729992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] PATH_INFO: `/v3/system/users/85d533098ae3466b8d572092dce271eb/roles/d7a9ba1e31cc4e51981bfdc9cd456409` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.731485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85d533098ae3466b8d572092dce271eb, role_id=d7a9ba1e31cc4e51981bfdc9cd456409)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.733474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531ef1a-8f03-4e12-b3ce-907ace3b52d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.746572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 172/333] 10.222.0.30 () {58 vars in 1334 bytes} [Fri Sep 9 06:15:47 2022] PUT /identity/v3/system/users/85d533098ae3466b8d572092dce271eb/roles/d7a9ba1e31cc4e51981bfdc9cd456409 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:15:47.851742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:47.859297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee73e4-2f2a-43e8-beed-61ae824c8d48 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:47.905078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:47.905710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:47.905993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:47.906272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:47.907019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] RBAC: Adding query filter params (role.id=fcc0608f8ce34c0185225cd3159438bd, user.id=a105f11642854ef29863e27d17e4e82e, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:47.907331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:47.908914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05144-3379-4bad-a8a5-642b99d7dd73 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:47.923587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 162/334] 10.222.0.30 () {56 vars in 1308 bytes} [Fri Sep 9 06:15:47 2022] GET /identity/v3/role_assignments?user.id=a105f11642854ef29863e27d17e4e82e&scope.system=all&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:49.716836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40837-fa1e-4b4b-8cb6-62e6929f553d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:49.717678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40837-fa1e-4b4b-8cb6-62e6929f553d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:49.718127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c40837-fa1e-4b4b-8cb6-62e6929f553d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:49.719598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 173/335] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:49.725327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b1a2-5bdf-4950-9768-dde3ef4a6928 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:49.725799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b1a2-5bdf-4950-9768-dde3ef4a6928 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:49.726079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b1a2-5bdf-4950-9768-dde3ef4a6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:49.753678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d358b1a2-5bdf-4950-9768-dde3ef4a6928 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:49.754904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d358b1a2-5bdf-4950-9768-dde3ef4a6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:49.828899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 163/336] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:50.208828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d25-a817-400b-9076-f1e6d5985f7d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.209116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d25-a817-400b-9076-f1e6d5985f7d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.209679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d25-a817-400b-9076-f1e6d5985f7d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.211212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 174/337] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:50.217193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.217703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.218180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.239357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:50.240919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:50.277225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2d25-a817-400b-9076-f1e6d5985f7d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:50.320909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 164/338] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:50.408955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2d25-a817-400b-9076-f1e6d5985f7d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:50.447441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:50.461621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:50.462259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.462538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.462811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.474450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-acecdf25-963f-410c-9148-dfec4494adb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:50.479292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:50.480165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:50.481471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 175/339] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:50.486524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:50.505996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:50.608099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2cc3-1830-4c45-9902-da377ba5c6a7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:50.651355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:50.653614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f04-c445-49a5-93a9-d9f95a5fb107 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.653886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f04-c445-49a5-93a9-d9f95a5fb107 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.654156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f04-c445-49a5-93a9-d9f95a5fb107 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.655629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 176/340] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:50.655743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.656160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.656439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.657526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:50.657833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:50.659293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:50.661273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ee99b-bedd-4103-b076-226fe0a182d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.661613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ee99b-bedd-4103-b076-226fe0a182d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.661887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ee99b-bedd-4103-b076-226fe0a182d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.688982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 165/341] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:50.697232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-666ee99b-bedd-4103-b076-226fe0a182d7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:50.698488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-666ee99b-bedd-4103-b076-226fe0a182d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:50.702475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:50.808719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 177/342] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:50.817780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273e8a-86c7-4f13-b4e4-ec43ba9fc469 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.817780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273e8a-86c7-4f13-b4e4-ec43ba9fc469 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.817780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273e8a-86c7-4f13-b4e4-ec43ba9fc469 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:50.819290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 178/343] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:50.826735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273e8a-86c7-4f13-b4e4-ec43ba9fc469 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:50.862950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:50.906268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7242-35c4-4824-92e4-191486d00a28 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:50.964665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:50.965852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:50.966137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:50.966413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.039989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273e8a-86c7-4f13-b4e4-ec43ba9fc469 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.057500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.085568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.086216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.086500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.086773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.110578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0be94eb9-569f-4fe7-a9ff-2cce5c3c176e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:51.115455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:51.116327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:51.117163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 179/344] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:51.117828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:51.118970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:51.129194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.129479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.129930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.161475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:51.162710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:51.239665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.254720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 180/345] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:51.254720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.270216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 166/346] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:51.272335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.357449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8b2d-7b3e-4f84-b899-c08c302273f4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.360642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.396044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.396698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.396984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.397259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.397937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:51.398242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:51.399671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:51.409145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 181/347] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:51.409988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.490905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075fcbd-276f-4ac4-b530-49cc6b7632b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.515898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffe4a0-7511-49fd-b610-81b9d0ee505f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.552942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.553672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.554024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.554310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.555734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:51.557314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:51.558107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.558978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.559086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 182/348] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:51.559537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.559762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.560171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.581604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:51.586535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:51.587459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:51.588692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 167/349] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:51.595482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.602834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.673403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f26547-5a41-40d8-ae06-015173e8914e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.675348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.720825 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.721451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.721733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.722120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.804281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216942-8752-482e-9eee-64fa308b83e2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:51.808644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:51.810398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:51.850391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:51.853870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:51.854716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:51.855062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:51.855400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:51.865562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:51.867535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:51.870273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 168/350] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:51.871076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:51.942421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 183/351] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:51.943273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.007931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a766-67e3-4f5b-823c-aa2f88c24fbf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.010408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.050308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.051090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.051725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.052009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.052980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:52.053288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.054896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.065074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45131b4-6650-46c5-bcd7-942ae2512c99 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.067352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 169/352] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.068191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.108955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.115036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.115796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.116169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.116557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.128186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c9aa0c7c-da70-4fde-9c81-6b9011d79109 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:52.133635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:52.134522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 184/353] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:52.136036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab854-f9a3-4a81-8a68-4d47adf2702e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.137419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab854-f9a3-4a81-8a68-4d47adf2702e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.137419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab854-f9a3-4a81-8a68-4d47adf2702e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.138212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 185/354] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:52.138905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab854-f9a3-4a81-8a68-4d47adf2702e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.210926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3382d5-3ece-4fc2-af16-6e14d7953d53 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.258095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.258711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.258989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.259701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.260510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:52.260838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.262793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.270765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 170/355] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.271470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.283842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab854-f9a3-4a81-8a68-4d47adf2702e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.308304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.337093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.338215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.339517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.340118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.342658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.344757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.347148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 186/356] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.349169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.415541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab51a-3083-4592-9c8f-bdf4cf03ceff None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.427205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.467875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.468644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.469004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.469342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.495235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefedee-310d-431b-9e90-1c56216a34ec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.537494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.538109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.538390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.538661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.539320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:52.539621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.541665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b539cb-3af4-4a1b-90fe-57995ee9d140 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.550889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 187/357] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.551959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.552219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.552493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.568919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.570635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cf838-773d-496f-aa5b-ea60408ffee8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.571371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:52.572533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:52.613367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.658389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 188/358] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:52.658389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.706556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 171/359] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:15:52.708273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaccaf-3ae2-45d8-a1d7-3e79014cda04 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.708875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaccaf-3ae2-45d8-a1d7-3e79014cda04 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.709354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaccaf-3ae2-45d8-a1d7-3e79014cda04 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.710858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 172/360] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:52.711771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaccaf-3ae2-45d8-a1d7-3e79014cda04 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.732440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.791655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5adca-fd71-423a-883c-5d26081848c2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.831214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaccaf-3ae2-45d8-a1d7-3e79014cda04 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.832037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.833327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.833607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.833877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.835694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.837162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.838717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 189/361] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.839470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:52.877636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:52.891374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:52.892019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.892302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.892591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] PATH_INFO: `/v3/users/85d533098ae3466b8d572092dce271eb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.894618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] RBAC: Authorizing `identity:get_user(user_id=85d533098ae3466b8d572092dce271eb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:52.896079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8d134-fe38-4296-8e40-52b2fda2a491 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:52.898701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 173/362] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/users/85d533098ae3466b8d572092dce271eb => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:52.899911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:52.900200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:52.900476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:52.924505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:52.926442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:52.974457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc88b4-f58d-40d2-93c1-20e3175705b7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:52.996493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.008832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 174/363] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:53.009759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.017913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.018682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.018965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.019242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.020503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.022089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.023710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 190/364] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:52 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.028814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.121682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9b2a-a910-4661-bd6c-c3e97e30f8a2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.151667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.156816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcedd9-d21c-450f-b0ed-13bcb9bb86b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.162777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.163492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.163875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.164220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.165088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:53.165500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.166939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.173893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 175/365] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.174711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.208095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.208980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.209426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.209795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.211287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] RBAC: Adding query filter params (role.id=d7a9ba1e31cc4e51981bfdc9cd456409, user.id=85d533098ae3466b8d572092dce271eb, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:53.211857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.213562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.228544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 191/366] 10.222.0.30 () {56 vars in 1308 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/role_assignments?user.id=85d533098ae3466b8d572092dce271eb&scope.system=all&role.id=d7a9ba1e31cc4e51981bfdc9cd456409 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.229444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.313667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.382889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1439450-cdfc-48d8-812b-349750916e84 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.426886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.427666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.428030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.428384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.429748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.430590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f52a6-d057-43be-a93f-bedb6d43ab8a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.431392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.434270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 192/367] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.435201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.504694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.505359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.505642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.505919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.535298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:53.541646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:53.542600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:53.543981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 176/368] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:53.544709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.617046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176810df-5d0b-43fa-bd4d-26c4e884e618 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.619231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.632539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.658865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.659441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.659722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.659998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.672879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:53.676661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22abf-6c72-408a-9235-727ccab9e08b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:53.678830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:53.679707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:53.680531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:53.684786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 193/369] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:53.685556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.716350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.716997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.717281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.717558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.718357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=dca469b42ca84e9eac97aec680481833) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:53.718704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.720275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.726712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 177/370] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.727582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.826166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b4f3-8fb0-4880-9177-8bfac738df6e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.869072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.869854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.870011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.870273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.870967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:53.871395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.872864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:53.882963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 194/371] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:53.890052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:53.918493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a94c-fb0f-4381-b956-cce8c5c55e67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:53.936554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.949131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:53.983789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:53.984421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:53.984731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:53.985162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:53.985833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:53.986140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:53.987619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.001753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 178/372] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:54.007439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8ff7-4483-4efc-a1ce-03e66fb6fd3c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.007697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.050598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:54.051226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:54.051506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:54.051776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:54.137141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:54.138605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.174081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ebce-4ae2-4913-b2b5-e7f12ee563e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.197085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:54.251844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:54.252461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:54.252789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:54.253061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:54.321632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 195/373] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:54.327999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.357950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:54.408098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:54.409600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.518422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe279-ea62-4c40-af8c-d6065a2eb741 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.557404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 179/374] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:15:54.561855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:54.562674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:54.562955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.563333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:54.563748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:54.565378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:54.567937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.570085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 196/375] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:54.575695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.585026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:54.671843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:54.694370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4115af4-6ec9-4439-822b-727385291728 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.732222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:54.732920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:54.733197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:54.733576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] PATH_INFO: `/v3/projects/39226271c3254aef844c491c22cbe083` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:54.734723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] RBAC: Authorizing `identity:get_project(project_id=39226271c3254aef844c491c22cbe083)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:54.736270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.738320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 180/376] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/projects/39226271c3254aef844c491c22cbe083 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:54.753813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.761449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123f43-6ce5-41d7-9dba-b70a6f468113 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.806466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:54.807028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:54.807308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:54.807582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:54.809303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:54.810760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:54.816699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 197/377] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:54.818468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:54.937145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177c-d00f-40be-a30e-3298faf2d8ef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:54.961501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:55.009950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843ac00-6c5c-4f51-812d-2d935006e2b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:55.017308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:55.017966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.018245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.018520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] PATH_INFO: `/v3/groups/487a811147644094b31e71606462025b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.033983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] RBAC: Authorizing `identity:get_group(group_id=487a811147644094b31e71606462025b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:55.035435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295dc97-c08d-467b-9deb-9c83129dffab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:55.037123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 181/378] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/groups/487a811147644094b31e71606462025b => generated 229 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:55.046019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe613a0-fb0e-4262-8cc0-8bb82c8ce6f7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.046285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe613a0-fb0e-4262-8cc0-8bb82c8ce6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.046559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe613a0-fb0e-4262-8cc0-8bb82c8ce6f7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.047960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 182/379] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:55.048515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe613a0-fb0e-4262-8cc0-8bb82c8ce6f7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:55.057386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:55.058353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.058881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.059357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.060351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=dca469b42ca84e9eac97aec680481833) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:55.060892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:55.062691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cc133-ae35-41ae-ac10-928aa217ae7c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:55.067065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:55.070886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 198/380] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:15:54 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:55.078152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.078510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.078858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.115501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:55.116872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:55.206457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe613a0-fb0e-4262-8cc0-8bb82c8ce6f7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:55.230993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 199/381] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:55.274684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:55.275316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.275593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.275860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.276628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] RBAC: Adding query filter params (group.id=487a811147644094b31e71606462025b, role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=39226271c3254aef844c491c22cbe083) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:55.276942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:55.278527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:55.293478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 183/382] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:15:55 2022] GET /identity/v3/role_assignments?group.id=487a811147644094b31e71606462025b&scope.project.id=39226271c3254aef844c491c22cbe083&role.id=ab615789e49a44a7956ada7180efdd20 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:55.522988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:55.595282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:55.631030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d87c2a-a6ea-4b1f-b65e-113d50521cca None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:55.666479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:55.667125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.667409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.667684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.680824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4324d81a-0fd7-43d7-9369-499d7cd1b799 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:55.687751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:55.688800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:55.689645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:15:55.692665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 200/383] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:55.695648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:55.800698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:55.831212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7f30-5e3c-46f4-8867-4ae5faf37b51 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:55.874169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:55.875180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.875674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.876206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.877150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:55.877670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:55.879269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0691109-16ff-46cd-ac01-af99a3093fa5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:55.893264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 184/384] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:55.895617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b3f7d-6135-4452-a7d6-1a8c77cbf426 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.895902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b3f7d-6135-4452-a7d6-1a8c77cbf426 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.896179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b3f7d-6135-4452-a7d6-1a8c77cbf426 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.898631 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 201/385] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:55.902878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:55.903162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:55.903441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:55.904350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b3f7d-6135-4452-a7d6-1a8c77cbf426 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:55.927434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:55.928539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:56.032472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 185/386] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:56.073818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b3f7d-6135-4452-a7d6-1a8c77cbf426 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:56.104001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:56.116727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:56.117366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:56.117645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:56.117974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:56.119443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:56.121074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:56.122785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 202/387] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:55 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:56.128725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:56.207272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:56.250808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22801-4b95-49e7-a20b-a3b34fcbb00a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:56.292553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:56.293292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:56.293569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:56.293903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:56.297250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:56.298706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:56.300520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 186/388] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:56 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:56.306146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:56.429423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1526b-229f-4ac8-a812-b32975af1b21 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:56.469886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:56.470560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:56.470827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:56.471096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/groups/b544fe948c624b7998eef6c02962b229/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:56.477118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:56.477390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, group_id=b544fe948c624b7998eef6c02962b229, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:56.478889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:56.504532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 203/389] 10.222.0.30 () {58 vars in 1442 bytes} [Fri Sep 9 06:15:56 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/groups/b544fe948c624b7998eef6c02962b229/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:56.641304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5b5d-9ca9-4f76-ba58-5d6267ef9977 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:56.686004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:56.686959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:56.687416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:56.687874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:56.690202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:56.703467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:56.708441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:56.709494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:56.710299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 187/390] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:56.715983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:56.778225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:56.833938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4386ba9-b923-4c6e-8e15-a9383b1ac6ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:56.869598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:56.870239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:56.870542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:56.870899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:56.871568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:56.871875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:56.873265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf2900-ea8b-4991-a96e-83d69522f189 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:56.881821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 204/391] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:56.887944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.001848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627a47-514f-4ad3-bbfe-9223f1815d14 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.002193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627a47-514f-4ad3-bbfe-9223f1815d14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.002395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627a47-514f-4ad3-bbfe-9223f1815d14 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.003843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 205/392] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:15:57.017113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885cbc-0cbc-4858-afbc-f2dabd32fa9c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:57.021950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.022236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.022514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.050517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:57.051721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:57.100857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:57.101563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.101779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.102055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.105521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:57.106980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:57.108858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 188/393] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:56 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:57.117216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.160735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 206/394] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 06:15:57.223405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:57.283830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba715-e09a-4aa9-906c-2fd8074ab65e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:57.333295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:57.333932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.334211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.334482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.341318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:57.342770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:57.344794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 189/395] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:57 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:57.350507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.437673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:57.515492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.548675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759abaa-b021-4104-a477-725eaf4e3473 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:57.616338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:57.617024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.617299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.617571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/groups/b544fe948c624b7998eef6c02962b229/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.621518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8e0a28ca40b42d19bb925591ed5f130, group_id=b544fe948c624b7998eef6c02962b229, role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:57.624437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:57.657722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 207/396] 10.222.0.30 () {58 vars in 1442 bytes} [Fri Sep 9 06:15:57 2022] PUT /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130/groups/b544fe948c624b7998eef6c02962b229/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:57.693481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e088c-e4b2-4ef7-90b7-67dc965a5e0b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:57.734360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:57.743599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:57.744486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.744789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.745059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.760836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:57.766575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:57.767478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:57.768313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 190/397] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:57.775499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.913744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33232-df3c-4f9f-8e4c-ac2624b8f0a6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:57.923035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:57.952054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:57.952727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.953264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.953632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.954426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:57.954825 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:57.956305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da023b3-5200-4eb2-b159-0c54c15bbc9d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:57.967667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 208/398] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:57.973445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:57.996784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645262-dd19-401a-8746-ba1c7cf57d8a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:57.997125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645262-dd19-401a-8746-ba1c7cf57d8a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:57.997336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645262-dd19-401a-8746-ba1c7cf57d8a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:57.998988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 209/399] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:58.004489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.004794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.005073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.025623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:58.026868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:58.107137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 210/400] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:58.120149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31069-70a0-4c36-9eb5-86b693e40ff4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.168350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.168952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.169235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.169509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.173226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:58.174664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5091afc-07e6-4285-a535-0e0b6c5d7889 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:58.179461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 191/401] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:57 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:58.197717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.232660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60236-a0f0-4034-a921-f22ad5123132 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.232963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60236-a0f0-4034-a921-f22ad5123132 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.233210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60236-a0f0-4034-a921-f22ad5123132 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.235206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 192/402] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:58.240933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.241221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.241498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.262253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:58.263668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:58.325416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:58.344311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 193/403] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:15:58.401630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:58.405832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a2bf-efc1-48be-bcfe-373b6600e91c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.424229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.465384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.466038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.466321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.466597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.468202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:58.470234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:58.476597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 211/404] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:58.479690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.574796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92731e-dc5c-456c-a12c-3e91169ce847 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.637854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5943e-daf1-486f-bf66-70a96e2205c7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.640689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.641332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.641612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.641882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.661521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:58.666385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:58.667375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:58.668249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 194/405] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:15:58.668954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.694271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.695462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.696301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.697065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/groups/b544fe948c624b7998eef6c02962b229/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.699310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, group_id=b544fe948c624b7998eef6c02962b229, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:58.700967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:58.719112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 212/406] 10.222.0.30 () {58 vars in 1442 bytes} [Fri Sep 9 06:15:58 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/groups/b544fe948c624b7998eef6c02962b229/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:15:58.720615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.724073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:58.776548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:58.832697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cac85-f88e-4ba7-b751-85189b77d449 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.906505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.907762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.908389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.908882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.920533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9d1bc-0fa7-41f1-bcc0-fb2856b35371 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:58.924593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:15:58.929920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:15:58.930890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:15:58.931692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:15:58.935775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 195/407] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:15:58.941906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:58.968069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:58.968645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:58.968929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:58.969204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:58.969872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:58.970219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:58.971592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:58.981477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 213/408] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:58.987736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.078335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:59.091403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2898e13-afff-4511-8884-e3e602f16136 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.101607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4b62-26a3-49c1-ab6d-cffe335d86bc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.102280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:59.148774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.150170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.150773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.151973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.153776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:15:59.154468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.156978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.171268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 196/409] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:15:59.179502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.180165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.180450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.182327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.186042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.187528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.189233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.191319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 214/410] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:58 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:59.197440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.364346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8fd6c-7efc-4a38-916c-8d5d3b1b896e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.379110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3263b47-f0da-45b6-81c1-8d8e0570ba25 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.420394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.421434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.421935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.422427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] PATH_INFO: `/v3/groups/487a811147644094b31e71606462025b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.423802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] RBAC: Authorizing `identity:get_group(group_id=487a811147644094b31e71606462025b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.425471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.427594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 197/411] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:15:59 2022] GET /identity/v3/groups/487a811147644094b31e71606462025b => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:59.432039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.432720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.433538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.433655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.433815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.434965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.436382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.438180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 215/412] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:59 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:59.449560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.486254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:59.492469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:59.566266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b58d-1eb4-4114-8c77-42f4fc4e8a22 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.575890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cde3-fcb2-4fb7-b51c-e90edeb60377 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.613438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.614128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.614463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.614666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.614794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] PATH_INFO: `/v3/projects/39226271c3254aef844c491c22cbe083` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.615781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] RBAC: Authorizing `identity:get_project(project_id=39226271c3254aef844c491c22cbe083)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.616059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.616549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.617110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833/groups/b544fe948c624b7998eef6c02962b229/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.617230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ac59-1f5a-441e-91ea-bb15f0e0045c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.619618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca469b42ca84e9eac97aec680481833, group_id=b544fe948c624b7998eef6c02962b229, role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.621331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0007a-fdb1-4085-b5d4-853967500977 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.623767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 198/413] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:15:59 2022] GET /identity/v3/projects/39226271c3254aef844c491c22cbe083 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:15:59.625557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8691b-a8aa-4539-b173-3dcc0b786f96 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.625557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8691b-a8aa-4539-b173-3dcc0b786f96 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.625762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8691b-a8aa-4539-b173-3dcc0b786f96 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.627183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 199/414] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:15:59.627777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8691b-a8aa-4539-b173-3dcc0b786f96 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:15:59.645121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 216/415] 10.222.0.30 () {58 vars in 1442 bytes} [Fri Sep 9 06:15:59 2022] PUT /identity/v3/projects/dca469b42ca84e9eac97aec680481833/groups/b544fe948c624b7998eef6c02962b229/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:15:59.647484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.648016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.648800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.676075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:15:59.677714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:15:59.760059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 217/416] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:15:59.761189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8691b-a8aa-4539-b173-3dcc0b786f96 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:15:59.769803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:15:59.801700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:15:59.802752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:15:59.803295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:15:59.803764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] PATH_INFO: `/v3/projects/39226271c3254aef844c491c22cbe083/groups/487a811147644094b31e71606462025b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:15:59.806183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=39226271c3254aef844c491c22cbe083, group_id=487a811147644094b31e71606462025b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:15:59.808133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:15:59.832339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 200/417] 10.222.0.30 () {58 vars in 1442 bytes} [Fri Sep 9 06:15:59 2022] PUT /identity/v3/projects/39226271c3254aef844c491c22cbe083/groups/487a811147644094b31e71606462025b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:00.078646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:00.095784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:00.192613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a529d-df4c-4320-93d8-0fe631c67dbc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:00.221768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:00.222667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:00.222941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:00.223210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:00.233762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-670ae260-46ee-4ae1-b06d-10f2efbcb2ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:00.238574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:00.239484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:00.240271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 218/418] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:00.245978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:00.375177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d411d-4fb2-43ea-aea1-fd4e755533d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:00.427337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f896-f28b-47a1-a96a-15c664770e56 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:00.428201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f896-f28b-47a1-a96a-15c664770e56 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:00.428482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f896-f28b-47a1-a96a-15c664770e56 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:00.429821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 219/419] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:00.438314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203de23-b051-4553-8e38-b0233595e971 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:00.438481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:00.438589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203de23-b051-4553-8e38-b0233595e971 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:00.438847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203de23-b051-4553-8e38-b0233595e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:00.439009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:00.439249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:00.439526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:00.440193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:00.440497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:00.441978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:00.451123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 201/420] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:00.463288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:00.476097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b203de23-b051-4553-8e38-b0233595e971 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:00.483146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b203de23-b051-4553-8e38-b0233595e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:00.518067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:00.626426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 220/421] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:00.647312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33427a45-ff82-4a8b-ae2c-577dfdff4fac None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:00.710908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:00.710908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:00.710908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:00.710908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:00.807971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:00.809801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:00.852677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:00.946208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203de23-b051-4553-8e38-b0233595e971 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:00.949360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:00.954249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 202/422] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:00.960407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.127577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203de23-b051-4553-8e38-b0233595e971 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.145878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af5401-724a-47e2-8225-a2021756f53c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.188594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:01.197930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.199028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.199307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.199578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.201718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:01.203148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:01.207408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 203/423] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:16:00 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:01.208095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.208811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.209096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.209460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.210680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.231778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:01.236704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:01.237649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:01.238456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:01.244538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 221/424] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:01.247885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.377915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:01.413079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f650a0e-7aa3-4851-87fa-f129dac7e731 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.442806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe4e-4185-4d39-8bb0-aa83146e6be4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.458113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.459198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.459198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.459607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.460917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:01.462436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b1f3-765a-4a65-8122-6f43d3fe77c1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:01.465104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 204/425] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:01.466443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614983d-bbb0-45f8-a501-421d75121b53 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.466786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614983d-bbb0-45f8-a501-421d75121b53 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.467123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614983d-bbb0-45f8-a501-421d75121b53 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.468646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 205/426] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:01.473888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614983d-bbb0-45f8-a501-421d75121b53 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.484062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.484800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.485154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.485501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.486257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:01.486622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:01.487993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f861ed-7f54-4689-8d13-7f0354e5c8b5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:01.501143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 222/427] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:01.501143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.501143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.501143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.516667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:01.517988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:01.550944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:01.600732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 223/428] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:01.601607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614983d-bbb0-45f8-a501-421d75121b53 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.601999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.644615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.646183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.646608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.647633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.648745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:01.650269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:01.653136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:01.663674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 206/429] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:01.690184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:01.746120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562fd99-b30a-40a7-85b1-025edde3ad21 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:01.782697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:01.783314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:01.783590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:01.783862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:01.857007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:01.858503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:01.921078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:01.943375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:01.972880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 224/430] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:01.981672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.060593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc73d-97c6-48c3-8368-992ac02cf586 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.097235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:02.102150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37093b74-8847-4479-817d-da83e2bf4b33 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.113605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.114607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.115085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.115575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.130816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:02.139767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:02.141151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:02.141968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 207/431] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:02.148330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.148868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.149791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.150285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.150754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] PATH_INFO: `/v3/projects/a8e0a28ca40b42d19bb925591ed5f130` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.154019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] RBAC: Authorizing `identity:get_project(project_id=a8e0a28ca40b42d19bb925591ed5f130)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.155695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.158529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 225/432] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:16:01 2022] GET /identity/v3/projects/a8e0a28ca40b42d19bb925591ed5f130 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:02.162966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.203565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:02.275754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a01f1-0fd5-43fa-a250-a00b550a64af None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.308966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3d64a-815e-4b59-bef9-1905dc89ecf3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.326243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.327482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.328051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.328895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.329525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:02.330008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.331585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.342481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 208/433] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:02.347806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.361410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.362286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.362712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.363142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.364964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.367378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.369936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 226/434] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:02.377126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.421563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:02.490384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8716-0abf-4a21-bbeb-011618dbe2f3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.516497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:02.529609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af895ca-9379-4932-b003-86ad2583d841 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.540157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.541170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.541678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.543216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.571543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.572156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.572443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.572753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.574031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=a8e0a28ca40b42d19bb925591ed5f130) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:02.574360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.575762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62d24-05bb-4ebd-accf-9d44e3ce2ded None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.582258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 227/435] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=a8e0a28ca40b42d19bb925591ed5f130&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:02.583581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1247-9c5f-47c8-a768-5b92c146d19c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.583865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1247-9c5f-47c8-a768-5b92c146d19c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.584137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1247-9c5f-47c8-a768-5b92c146d19c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.586451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 228/436] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:02.587619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d379b-7c44-4a51-91e0-ec0f890c7ecd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.587895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d379b-7c44-4a51-91e0-ec0f890c7ecd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.588162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d379b-7c44-4a51-91e0-ec0f890c7ecd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.590374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 229/437] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:02.593293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077dce-2cfc-40e8-ab44-6402bc001899 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.593580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077dce-2cfc-40e8-ab44-6402bc001899 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.593858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077dce-2cfc-40e8-ab44-6402bc001899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.614703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d1077dce-2cfc-40e8-ab44-6402bc001899 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:02.617097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d1077dce-2cfc-40e8-ab44-6402bc001899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:02.632061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.633764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.710467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:02.724235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 230/438] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:02.724235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.724235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.724235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.738667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:02.740868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:02.783517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 209/439] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:02.789407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.834481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 231/440] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:02.902251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc25c6-4815-4c77-a726-3d5571313b3e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:02.937422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:02.938328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:02.938777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:02.939220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:02.940635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:02.942339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:02.944470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 210/441] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:02.950722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:02.968668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.007434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.027583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.064904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8bfb-716a-4355-8558-ed755d962e73 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.100752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.101625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.102074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.102534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.103779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.105444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.111909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 232/442] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:16:02 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:03.112931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.118298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c47d-379b-4adf-900b-2f9370ecd7f7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.153652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.154274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.154555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.154829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.164666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:03.169444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:03.170515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 211/443] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:03.171320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.200443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.216315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4101c8-0047-4962-951a-cd3060be6633 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.249242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.249399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.249835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.250116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.250442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.251099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=fcc0608f8ce34c0185225cd3159438bd, scope.project.id=dca469b42ca84e9eac97aec680481833) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:03.251410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.252849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.261495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 233/444] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=fcc0608f8ce34c0185225cd3159438bd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:03.262339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.285501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c5dc3-325c-442d-96fe-598eaf4fee8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.324655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.325321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.325610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.325886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.338461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:03.343951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:03.344955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:03.349524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 212/445] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:03.351772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.391904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278464-7a83-4250-84f4-ee6d2176d725 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.430810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.431522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.431834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.432184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.433615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:03.433999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.436635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.448612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 234/446] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:03.453167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.468985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.478807 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f073e5c-9b9b-41cc-8d96-798336bb88e7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.524494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.525190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.525473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.525968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.526509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:03.526869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.529344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.538575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.548776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 213/447] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:03.550169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.605080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff5908-58f6-4d6b-aa11-92e709c20124 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.654314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.654539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.654908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.655080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.700451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b25f8-d750-4ce9-9cbc-e1fe4b9d6bde None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.730506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.732006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.733284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.733891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.734171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.734449 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.742898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.799217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.801961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.803867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.831197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 235/448] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:16:03.836592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.900713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 214/449] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 06:16:03.906645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:03.937068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e508b-cb55-42c4-8beb-8a348a844828 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:03.948549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:03.971506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:03.972390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:03.972694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:03.972967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] PATH_INFO: `/v3/projects/39226271c3254aef844c491c22cbe083` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:03.974057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] RBAC: Authorizing `identity:get_project(project_id=39226271c3254aef844c491c22cbe083)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:03.975503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:03.977126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 236/450] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/projects/39226271c3254aef844c491c22cbe083 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:03.983164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:04.001462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:04.004514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1eda5-38c9-4bb5-a013-9b1610b24e76 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:04.038816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:04.039558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:04.039844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:04.040122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] PATH_INFO: `/v3/projects/dca469b42ca84e9eac97aec680481833` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:04.041266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] RBAC: Authorizing `identity:get_project(project_id=dca469b42ca84e9eac97aec680481833)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:04.042811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:04.044451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 215/451] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/projects/dca469b42ca84e9eac97aec680481833 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:04.049825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:04.083203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd958fc-bca7-47bd-bc36-0928d8156c46 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:04.115732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:04.116347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:04.116651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:04.116935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] PATH_INFO: `/v3/groups/487a811147644094b31e71606462025b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:04.118030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] RBAC: Authorizing `identity:get_group(group_id=487a811147644094b31e71606462025b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:04.119443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:04.121563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 237/452] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:16:03 2022] GET /identity/v3/groups/487a811147644094b31e71606462025b => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:04.127420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:04.150401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b802a5-f97b-4181-9d07-fbea39b1c67d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:04.171526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:04.185820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:04.186013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:04.186296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:04.186576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] PATH_INFO: `/v3/groups/b544fe948c624b7998eef6c02962b229` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:04.187689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] RBAC: Authorizing `identity:get_group(group_id=b544fe948c624b7998eef6c02962b229)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:04.189190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:04.190746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 216/453] 10.222.0.30 () {56 vars in 1180 bytes} [Fri Sep 9 06:16:04 2022] GET /identity/v3/groups/b544fe948c624b7998eef6c02962b229 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:04.196343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:04.226637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31876-afce-4bb3-86e2-4f0c6b8dcc1b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:04.231690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:04.262704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:04.263308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:04.263589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:04.263859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:04.264600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] RBAC: Adding query filter params (group.id=487a811147644094b31e71606462025b, role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=39226271c3254aef844c491c22cbe083) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:04.264914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:04.266334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65cd5-5a53-4019-8118-92ce9c9d66fb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:04.272056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 238/454] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:16:04 2022] GET /identity/v3/role_assignments?group.id=487a811147644094b31e71606462025b&scope.project.id=39226271c3254aef844c491c22cbe083&role.id=ab615789e49a44a7956ada7180efdd20 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:04.300092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71f3b-1f23-4862-895a-d44381c20a37 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:04.336339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:04.336992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:04.337269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:04.337539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:04.338274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] RBAC: Adding query filter params (group.id=b544fe948c624b7998eef6c02962b229, role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=dca469b42ca84e9eac97aec680481833) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:04.338583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:04.340013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7331f-d3e0-4bfe-9b56-0a6c11b34dab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:04.356870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 217/455] 10.222.0.30 () {56 vars in 1376 bytes} [Fri Sep 9 06:16:04 2022] GET /identity/v3/role_assignments?group.id=b544fe948c624b7998eef6c02962b229&scope.project.id=dca469b42ca84e9eac97aec680481833&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:07.125068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd16d9-6f2c-409e-aaf1-3c3ff03de0c6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.125595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd16d9-6f2c-409e-aaf1-3c3ff03de0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.125698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd16d9-6f2c-409e-aaf1-3c3ff03de0c6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.127648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 239/456] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:07.133479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca99c-4325-455d-927a-2234b79b1b39 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.134371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca99c-4325-455d-927a-2234b79b1b39 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.134920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dca99c-4325-455d-927a-2234b79b1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.162251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d8dca99c-4325-455d-927a-2234b79b1b39 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:07.163843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d8dca99c-4325-455d-927a-2234b79b1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:07.285805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 218/457] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:07.289132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fff-7743-43d9-940a-d234b5415552 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.289414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fff-7743-43d9-940a-d234b5415552 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.289684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1fff-7743-43d9-940a-d234b5415552 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.290986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 240/458] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:07.302297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6df2d-8028-4c9b-ba46-13a69d0cc1ce None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.302554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6df2d-8028-4c9b-ba46-13a69d0cc1ce None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.302828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6df2d-8028-4c9b-ba46-13a69d0cc1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.328745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-65d6df2d-8028-4c9b-ba46-13a69d0cc1ce None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:07.329924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65d6df2d-8028-4c9b-ba46-13a69d0cc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:07.367860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:07.422303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 219/459] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:07.607828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1fff-7743-43d9-940a-d234b5415552 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:07.648316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab219d-2f38-44dc-a93c-d7ab55bbb3ab None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.648970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab219d-2f38-44dc-a93c-d7ab55bbb3ab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.649460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab219d-2f38-44dc-a93c-d7ab55bbb3ab None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.651754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 220/460] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:07.657137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8acf1-7d97-4201-baa1-bb2dfeea3b55 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.657646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8acf1-7d97-4201-baa1-bb2dfeea3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.658130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8acf1-7d97-4201-baa1-bb2dfeea3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.687312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6fb8acf1-7d97-4201-baa1-bb2dfeea3b55 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:07.689186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6fb8acf1-7d97-4201-baa1-bb2dfeea3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:07.717641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1fff-7743-43d9-940a-d234b5415552 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:07.738808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:07.756459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:07.757323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.757741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.758148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.771746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 221/461] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:07.773378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51154215-53b4-4f39-b54c-68d5b4ac6a2f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.774768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51154215-53b4-4f39-b54c-68d5b4ac6a2f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.775206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51154215-53b4-4f39-b54c-68d5b4ac6a2f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.777453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 222/462] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:07.778346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:07.779935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:07.783079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.783512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.783937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:07.802374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:07.803533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:07.804585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:07.804585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:07.804585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:07.805438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:07.806750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 241/463] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:07.807707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:07.811462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:07.892927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 223/464] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:07.893834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:07.914989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871cfc1-5467-4532-8ecb-9b96e27be899 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:07.925837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:07.953596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:07.954150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:07.954431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:07.954792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:07.966093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:07.967527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:07.982976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:07.983869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:07.984745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:07.984745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:07.984745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:07.984745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 242/465] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:07.997801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.024486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.043814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776847b0-ab1b-4213-8a5c-b7a3ed766373 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.084821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.085432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.085711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.085981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.086632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:08.086934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.088388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.100512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 224/466] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:08.105086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.151869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166f26-7747-4aac-aaa0-d046fbb833e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.201831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.206011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.206573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.206854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.207122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.208131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:08.208438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.210250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.226687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2ad1-bc74-448a-b9a1-6f3a74b04af0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.236637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 243/467] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:08.237734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.265186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.266019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.266152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.266341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.277323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.278638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:08.294315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:08.295250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:08.296103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:08.296103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:08.296103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:08.296103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 225/468] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:08.296314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.332918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.361966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc091-0e11-4997-8ee6-b666d348beb9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.397745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.398350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.398629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.398829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2141cc-50d4-4c55-87f8-741c0ce373fc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.398930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.399526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.401501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.432596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 244/469] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:08 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:08.432596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.440593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.446447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.447247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.447751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.448265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.449382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.451457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.488142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 226/470] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:08 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:08.489458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.623123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca6f3-43e2-4f32-9a5e-681dd4f8753c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.675050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.686458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.688702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.689132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.689546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.700360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377bcf5-a19e-4991-9b0c-ccc1357da2be None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.703126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.705211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:08.722934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:08.723948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:08.724936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:08.724936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:08.724936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:08.724936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 245/471] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:08.744141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.747979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.748762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.749044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.749315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.749976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:08.750285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.751706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.768796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 227/472] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:08.773460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.835009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:08.868975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deac24-3543-4823-8249-c7501f37d2ad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.896420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f289-c7e3-4596-8a7d-e461b8875bdd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:08.909542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.910511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.910968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.911412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.912244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:08.912739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.914346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5119d-94bb-4568-bad6-684a246f362b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.928820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 246/473] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:08.930305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa264-1393-490a-b00b-91513e39d62f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.930754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa264-1393-490a-b00b-91513e39d62f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.931196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa264-1393-490a-b00b-91513e39d62f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.933113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 247/474] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:08.937896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa264-1393-490a-b00b-91513e39d62f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:08.939252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:08.939972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.940348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.940748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:08.941614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:08.943412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee0ae4-3a0c-4ac3-889d-969507df6a93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:08.972655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 228/475] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:08 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:08.974374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:08.974799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:08.975195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:09.013162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:09.017684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:09.019139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:09.138453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 229/476] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:09.161451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa264-1393-490a-b00b-91513e39d62f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:09.214559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:09.215524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:09.215949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:09.216365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:09.217189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:09.218810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:09.248724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 248/477] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:08 2022] POST /identity/v3/users => generated 248 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:09.437073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:09.472858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:09.544733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740cddc-a03f-496c-a9e0-c5e1fd0bed06 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:09.583831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:09.584466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:09.584748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:09.585017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:09.585697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:09.587062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:09.594983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 06:16:09.594983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 06:16:09.594983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [parameters: {'id': '6cc86b2ff84048ed80719481da8de967', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 06:16:09.594983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 09 06:16:09.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:16:09.613656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 06:16:09.614847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 06:16:09.615960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:16:09.616887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:16:09.617702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'id': '6cc86b2ff84048ed80719481da8de967', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:09.618588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 06:16:09.621160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:09.622081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 230/478] 10.222.0.30 () {60 vars in 1131 bytes} [Fri Sep 9 06:16:09 2022] POST /identity/v3/roles => generated 144 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:09.623697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:09.762576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:09.767414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3060a-2bbb-414b-921c-a9ae65bce3db None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:09.821264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:09.822362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:09.822905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:09.823384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:09.839907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-75e58ee9-28f1-44a7-8b3c-6273f7a68955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:09.845517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:09.846668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 06:16:09.847462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:09.852694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 249/479] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:09.856785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:09.999879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:10.003760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768109-f18b-4cf5-8a9a-0fb105f7465c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:10.048401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:10.048958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:10.049237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:10.049507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:10.050271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:10.050574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:10.051942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd3f6-bb71-4528-8035-d889fee8b06d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:10.064056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 231/480] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:11.021730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd60444-a5dd-49e1-bf2b-6e33d9738d4c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.022753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd60444-a5dd-49e1-bf2b-6e33d9738d4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.023235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd60444-a5dd-49e1-bf2b-6e33d9738d4c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.025282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 250/481] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:11.030194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.030614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.030787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.049921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:11.051438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:11.115268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f457ff-a3f6-41ec-8679-b2e5417a3a45 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.115577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f457ff-a3f6-41ec-8679-b2e5417a3a45 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.115828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f457ff-a3f6-41ec-8679-b2e5417a3a45 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.117426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 251/482] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:11.122113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.122394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.122666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.148081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 232/483] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:11.158864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:11.160127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:11.273007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 252/484] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:11.458034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:11.579406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:11.591394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57bb07-32b4-48e6-b694-49a760fb9bf9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:11.644554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:11.645231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.645513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.645615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:11.645810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.663978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:11.671542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:11.672413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:11.673259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:11.678778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 233/485] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:11.685016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:11.808210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:11.839219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71174155-6914-411b-96fd-9a2223c2b6ce None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:11.872259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba65da-6c0c-4c50-821b-06aad01767c7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:11.883481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:11.884396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.885439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.885905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.898705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f65f43aa-8188-41ab-a6c2-1f5a5d2f834f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:11.905325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:11.906201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:11.906986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:11.910147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 253/486] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:11.911977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981c7a-c40d-4d41-bb77-1e3cf77a5f04 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.912457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981c7a-c40d-4d41-bb77-1e3cf77a5f04 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.912946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981c7a-c40d-4d41-bb77-1e3cf77a5f04 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.918459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 254/487] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:11.918459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981c7a-c40d-4d41-bb77-1e3cf77a5f04 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:11.926600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:11.927560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.928043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.928508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.929599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:11.930093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:11.932308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a2309-b033-4569-a573-4f6d10da4e7d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:11.946306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 234/488] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:11.948845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:11.949346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:11.949828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:11.970246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:11.972115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:11.982069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.033189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981c7a-c40d-4d41-bb77-1e3cf77a5f04 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.057264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 235/489] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:12.058962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.077461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.078244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.078526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.078844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.079776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:12.079884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.081325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df23a1-48a7-40cb-91db-c591d09a697b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.090696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 255/490] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:12.091802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fb59-9f47-4d40-948d-a650a6a1f5c3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.092078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fb59-9f47-4d40-948d-a650a6a1f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.092349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fb59-9f47-4d40-948d-a650a6a1f5c3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.098588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 256/491] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:12.099316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fb59-9f47-4d40-948d-a650a6a1f5c3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.112160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.171951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921e2a2-137a-47b4-aa26-26e2d93d84fd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.206957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fb59-9f47-4d40-948d-a650a6a1f5c3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.210108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.210960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.211455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.211940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.223387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.225294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1255879f-a5e7-4d16-b1a6-c7e062dd93a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:12.240879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.241784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:12.242637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:12.242637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:12.242637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:12.242797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.242797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.242797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.243003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.250113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.250376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 236/492] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.251785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.252320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.252827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.256473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.257971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.271531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:12.272938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.273807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:12.274639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:12.274639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:12.274639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:12.274639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 257/493] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.274847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.276426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:12.342538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.351048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 237/494] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:12.352133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.385930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c314-6039-49a8-a697-f9ba0c656c7f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.421038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.421589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.421928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.422203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.423390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:12.423390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.424468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.436618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 258/495] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:12.437476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.453792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d75d3-ee1b-465d-8dfe-4f00063fcb44 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.481284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.491974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.493086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.493578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.495161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.496272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:12.496798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.499285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.518949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 238/496] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:12.518949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.552369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cdda-387b-45e8-9189-6da61fcebe50 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.582057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.597789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.598737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.599211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.600070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.614340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:12.621486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.623134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:12.623963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:12.628606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 259/497] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.628606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.635870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c70d-cdd0-4233-bf43-341dfcce165a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.671840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.672866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.673322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.673769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.682723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.684472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:12.698411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.699529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:12.700769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:12.702615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 239/498] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.703514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.731994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb933-e3de-488a-8674-0e05fb8067a6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.750837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.768365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.769285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.769575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.769836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.777623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.779075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:12.792865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.793780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:12.794694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 260/499] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.795258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.813418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547e54-27af-42d2-9eae-65103ad3f09f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.848953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:12.857210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.857945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.858254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.858712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.869741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:12.875007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:12.875896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 240/500] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:12.877693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.916714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdedf2-5bb1-42a5-868e-8e98d57bf05d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.952405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:12.953126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:12.953406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:12.953687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:12.954343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:12.954647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:12.956018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:12.964692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 261/501] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:12.965472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:12.984822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30618db2-e148-4a10-b8f6-d7c6fc9460f4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:12.987099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.018275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.018885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.019167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.019441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.020161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:13.020466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.021953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.058018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 241/502] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:13.058834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.068427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee435-4a05-4aeb-9048-064f93cc0ba0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.070763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.103117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.104193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.104482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.104796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.105514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:13.105826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.107245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437560-65dc-4ed8-a483-177601bf4faa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.148001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 262/503] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:13.149293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4468-593b-4136-97da-1c20ef0ee3e0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.149581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4468-593b-4136-97da-1c20ef0ee3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.149855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4468-593b-4136-97da-1c20ef0ee3e0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.151081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 263/504] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:13.151775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4468-593b-4136-97da-1c20ef0ee3e0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.162380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1b69-5504-499b-b1c1-cd8f2142f5e8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.198766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.199384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.199667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.199941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.200629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:13.200939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.202321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.210213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 242/505] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:13.210995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.237313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.260147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4468-593b-4136-97da-1c20ef0ee3e0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.293648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.294272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.294553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.294827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.304490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.305961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.311024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59e5e-c5b1-4430-ba86-db75c50c5b54 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:13.320839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:13.321742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:13.323281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:13.323281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.323281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:13.323281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 264/506] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:13.323281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.338939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.344777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.345390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.345675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.346199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.413776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.415165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef779b6-cf0a-488d-86e6-a52263a78b4e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.420970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7301-bb1a-4486-97cd-d35b402ddd23 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.438644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.453783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.454381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.454666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.454943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.514178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 243/507] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:13.515676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.515960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.516232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.534662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.536124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.537400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:13.538591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:13.550953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.604199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 244/508] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:13.612720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.646647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 265/509] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:13.649420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.666899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.715504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbee97d-1211-4d30-8bf8-5e02c5848948 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.750444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.751073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.751352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.751840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.754686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aec6ae-61b3-48dc-8408-47258d6a28f7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.761744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.763227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.769564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:13.778506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:13.779416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:13.780297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:13.780297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.780297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:13.780297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 245/510] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:13.781073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.795941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.796611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.796896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.797171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.797828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:13.798197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.799581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.817721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 266/511] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:13.817721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.890809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215c75-3484-4ff2-a0c5-a75e2dc7903e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.897687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:13.917623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8061f-33b9-4413-b6af-8893f294ccbf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:13.925959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1322-9109-41b4-a805-917950e21604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.926583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1322-9109-41b4-a805-917950e21604 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.926864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1322-9109-41b4-a805-917950e21604 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.927135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1322-9109-41b4-a805-917950e21604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.936823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1322-9109-41b4-a805-917950e21604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.938273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1322-9109-41b4-a805-917950e21604 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.951595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:13.952219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:13.952498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:13.952803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-156b1322-9109-41b4-a805-917950e21604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:13.953033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:13.953938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:13.954824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:13.954824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.954824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:13.954824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 246/512] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:13.955051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1322-9109-41b4-a805-917950e21604 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:13.967952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:13.969405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:13.983455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:13.984491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:13.985586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:13.985586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:13.985586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:13.985586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 267/513] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:13.985586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.014106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.057284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1322-9109-41b4-a805-917950e21604 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.083698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374883c-ace3-48c7-abc8-4df6e4c6947d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.091091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.091689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.091966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.092237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.092902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.093203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.094552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.105938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 247/514] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.106705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.117084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.117715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.117999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.118269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.124028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.126115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.127545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:14.139051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:14.140123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 268/515] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:14.141380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.211763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a799-33ad-4906-8f68-694f7c61082c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.227289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.242958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdadde-fe14-4868-a997-b925b193df6a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.245148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.245786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.246063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.246341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.255985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.257456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:14.272130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:14.273315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:14.274388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:14.274388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:14.274388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:14.274388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 248/516] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:14.274661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.279247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.279928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.280217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.280491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.281172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.281480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.282877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.298772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 269/517] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.298772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.344273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.375981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d254f8-e529-408d-9318-3313edf43e60 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.392597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bfb8-01d6-48b3-aa10-f0dab01918ea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.408611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.409220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.409502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.409776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.410414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.410719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.412103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.423659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 249/518] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.424249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.429681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.430312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.430592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.430867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.438849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.440236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:14.451679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:14.452731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 270/519] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:14.454268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.466016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.529083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b10b-ef1a-431d-9158-4bd7dd8f5de7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.556175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ca0a9-44e9-4d66-990c-c3458d0040d4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.557887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.564481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.565115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.565389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.565660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.566371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.566673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.568086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.585789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 250/520] 10.222.0.30 () {56 vars in 1139 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.586401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.593958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.594957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.595235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.595508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.596412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.596747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.598095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.610068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 271/521] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.610836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.675761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.692185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bb0a4-669b-4bfb-a1bf-229a24684f1b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.710623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473faa-04e0-48bf-9568-1163f369da69 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.726175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.726802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.727089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.727367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.733965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.735392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.744035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.744686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.744998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.745275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:14.747001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:14.748031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 251/522] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:14.749275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.751821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.753284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:14.765451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:14.766402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 272/523] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:14.767326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.802039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.855626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8327-3704-4c9d-a6ca-7ee01fe9fea9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.865101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a9764-44a1-4008-8ad1-4122c4f12e81 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:14.888699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.889274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.889551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.889821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.890329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:14.890531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:14.891034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.892414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:14.899736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:14.900965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:14.901245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:14.901516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:14.909890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 252/524] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:14.910671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:14.969913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:14.971555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.006170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2f83f-20d2-4f56-b2c7-cbacc660bd92 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.013266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.039889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.040490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.040873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.041150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.041791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.043201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.064385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 253/525] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:14 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:15.065208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.070241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 273/526] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:15.071136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.102219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.189236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9b62-166f-4d20-9995-716c3fce79fd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.192980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443fbfe-49bb-401b-85b9-b77ff0d7cd47 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.230022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.230234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.230639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.230739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.230920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.231065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.231227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.231321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.231870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:15.231968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:15.232176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.232271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.233634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.233736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.254892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 274/527] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:15.255193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 254/528] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:15.255728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.255983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.287941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.348411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.366254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70502-36ec-40ab-96e3-19c896c6a311 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.368443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046ca84-611b-42e1-afd2-5cfa4ef7ad17 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.403235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.403785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.403904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.404098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.404363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.404471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.404753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.405033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.416368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.417962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:15.434803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:15.435764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:15.436648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:15.436648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:15.436648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:15.440474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 255/529] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:15.441349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.473211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.474660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.521423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.548188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728f20a-09a0-4bec-972a-9e33abb30ab1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.564584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.582438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 275/530] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:15.583561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.587688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.588311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.588607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.588882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.589605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:15.589913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.591324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.597652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 256/531] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:15.598505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.703969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b69be1-1108-4740-be24-4a0d1aa716bc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.726973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e9412-653e-454d-97e7-8b954cabfd10 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.740259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.741064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.741352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.741632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.742372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=572694e1f16040bea41fa0445501d01e) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:15.742690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.744815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.757021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 276/532] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/role_assignments?user.id=572694e1f16040bea41fa0445501d01e&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:15.758010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.775435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.776452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.776936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.777378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.778272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:15.778779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.781126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.791616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.802322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 257/533] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:15.808166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:15.851958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:15.918108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39c5f-7043-4d66-96a9-c8cd0a66af06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:15.967972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:15.968997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:15.969503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:15.970102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:15.985276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:15.987453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:15.997740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfefa13-a87d-4d88-b9c3-cdd86608f2cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:16.005071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:16.006069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:16.006925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:16.006925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:16.006925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:16.006925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 277/534] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:16.012358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.045774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.046919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.047619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.048042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.057628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.059258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:16.087283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:16.088467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:16.089579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:16.091468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 258/535] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:16.114434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.206250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7e5b-92d7-489d-9516-66e4687d7bb9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.208516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:16.247902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.248881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.249637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.250116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.250927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:16.251428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.253140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.255498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:16.270243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 278/536] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:16.276658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.337141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010968-da0b-4bff-a959-5bf44b653ca2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.376050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.376702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.376983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.377254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.377946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:16.378251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.379672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.393856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 259/537] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:16.400628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.476112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe50ed9-6343-4121-b72f-3aaa61eb43e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.549867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.550989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.552236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.553929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.565315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.567950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:16.588043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:16.589122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:16.590211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:16.593527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa918778-e362-4c4e-8db2-b67f3c1cc02b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.602106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 279/538] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:16.607855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.625613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:16.648269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:16.670863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.671504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.671748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.672019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.672777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=71c93648e7be470794a3282fd043c195) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:16.673087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.674820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.687951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 260/539] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/role_assignments?user.id=71c93648e7be470794a3282fd043c195&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:16.760587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef6f8-9e2a-4ea4-8162-718e8db9b72b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:16.802600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:16.803517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:16.803956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:16.804375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:16.805249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:16.805707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:16.807359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53811d-f842-4100-92f0-a768ce7b82c5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:16.821469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 280/540] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:16.828063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:16.990216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86129164-c367-4a0a-b8d3-8841c613a739 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:17.030863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:17.031751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:17.032178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:17.032635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:17.033500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=4fdc7998a54c420c920fc0e54b91b930) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:17.033959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:17.035545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961be32-568e-40a8-8532-653d2e918180 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:17.042074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 261/541] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:16 2022] GET /identity/v3/role_assignments?user.id=4fdc7998a54c420c920fc0e54b91b930&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:17.457733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7b15-b571-42b5-a6af-ac366a171b24 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:17.458566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7b15-b571-42b5-a6af-ac366a171b24 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:17.459008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a7b15-b571-42b5-a6af-ac366a171b24 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:17.460766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 281/542] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:17.466284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:17.466720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:17.466889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:17.489921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:17.491131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:17.547012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:17.587142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 262/543] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:17.945779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a7b15-b571-42b5-a6af-ac366a171b24 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.057660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:18.085240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a7b15-b571-42b5-a6af-ac366a171b24 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:18.133274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:18.133926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.134309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.134585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.148697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-93477575-d643-4672-a80b-7b34883176c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:18.153986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:18.154852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:18.155649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 282/544] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:18.161178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.319484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7847ad-3ed7-4469-9b47-ce293699132c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.319682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ae21-0f55-4f50-899e-d3a99b62e6dc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:18.319761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7847ad-3ed7-4469-9b47-ce293699132c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.320022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7847ad-3ed7-4469-9b47-ce293699132c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.322303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 283/545] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:18.327801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8e53-b892-48bc-aa18-31bc76305d69 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.328082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8e53-b892-48bc-aa18-31bc76305d69 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.328467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8e53-b892-48bc-aa18-31bc76305d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.357290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:18.357904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.358185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.358460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.359124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:18.359430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:18.360892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe792-fff5-4079-9ff8-a655c3b55273 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:18.364925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-179f8e53-b892-48bc-aa18-31bc76305d69 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:18.366447 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-179f8e53-b892-48bc-aa18-31bc76305d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:18.372914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 263/546] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:18.374263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcef19-fa82-4c23-8ff3-3bfc3ed8c953 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.374560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcef19-fa82-4c23-8ff3-3bfc3ed8c953 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.374838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcef19-fa82-4c23-8ff3-3bfc3ed8c953 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.380275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 264/547] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:18.380275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcef19-fa82-4c23-8ff3-3bfc3ed8c953 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.422011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:18.447224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 284/548] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:18.454241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.454783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.455249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.487306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcef19-fa82-4c23-8ff3-3bfc3ed8c953 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:18.488808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:18.490562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:18.529658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:18.530296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.530580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.530849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.552278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:18.553786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:18.581208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:18.582110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:18.583029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:18.583029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:18.583029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:18.590728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 265/549] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:18.591894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.614847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 285/550] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:18.719038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:18.733540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf5c28-4ac9-4505-b343-eba14f2f57e1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:18.779649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:18.780270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.780549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.780845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.781486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:18.781790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:18.783153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:18.797634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 266/551] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:18.803370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.806458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:18.878856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:18.941134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd8700-5782-4a12-855f-d2a38279df26 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:18.985439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:18.986759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:18.987230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:18.987951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:18.997668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:18.999587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.010407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e83248-bbc4-482e-a1ae-8d617138835e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:19.016022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:19.017164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:19.018099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:19.020600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 286/552] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:19.021979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.051696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.053102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.053841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.054266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.070337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:19.075300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:19.076636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:19.077686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:19.084331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 267/553] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:19.084331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.094176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.112319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.163694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992176ac-b3e7-41da-acb3-ddd200a87662 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.196355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7632-da4e-47f1-821c-14fb5ca112ca None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.213835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.214528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.214817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.215091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.227463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:19.234685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:19.235622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:19.236537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:19.238078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.238957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.239496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.239976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.240628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 287/554] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:19.241209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:19.241450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.241929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.243690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.263361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 268/555] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:19.264660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.341512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.376731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd61b-0077-451b-8e53-62720c7c7101 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.377086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cda86-7d36-4088-a6da-35e240121b63 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.406304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.415699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.416250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.416533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.416841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.417505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:19.417816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.419202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.419361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.419960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.420238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.420641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.421297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:19.421603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.422939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a68e4-50ab-43d6-beea-7ef6c66ab12f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.428006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 269/556] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:19.429081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 288/557] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cfb16-64af-4a6a-95e5-cf89c7158378 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cfb16-64af-4a6a-95e5-cf89c7158378 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cfb16-64af-4a6a-95e5-cf89c7158378 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 289/558] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:19.436544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cfb16-64af-4a6a-95e5-cf89c7158378 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.543164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1af2-ea32-4b45-8b5d-1601bac98950 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.550833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cfb16-64af-4a6a-95e5-cf89c7158378 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.572914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.579766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.580371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.580679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.580952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.588770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.589620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.590082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.590583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.601565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.603283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:19.618105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:19.619700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:19.620633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:19.620633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:19.620633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:19.620633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 290/559] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:19.621251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.662317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.663463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.663775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c255a3-3482-40ff-aa98-dc7c1f5a55ed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.732366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba173ca-62d3-4325-8f88-7872b647abad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.767111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 270/560] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:19.768134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.768339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20b7a-b0f4-48fc-967c-456c5ce475ce None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.768653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20b7a-b0f4-48fc-967c-456c5ce475ce None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.768847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.768943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20b7a-b0f4-48fc-967c-456c5ce475ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.769125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.769341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.780006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.781463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.786003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-40f20b7a-b0f4-48fc-967c-456c5ce475ce None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:19.787186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40f20b7a-b0f4-48fc-967c-456c5ce475ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:19.795670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:19.796840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:19.797948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:19.797948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:19.797948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:19.797948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 291/561] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:19.797948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.813660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.856458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 271/562] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:19.857720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbf57-335e-4bcf-b25a-56d202f9e0ee None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.857998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbf57-335e-4bcf-b25a-56d202f9e0ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.858270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbf57-335e-4bcf-b25a-56d202f9e0ee None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.859626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 272/563] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:19.860161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dbf57-335e-4bcf-b25a-56d202f9e0ee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.889672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:19.905279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad3e58-da13-4de1-943d-cb89fac52de4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:19.940692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:19.941289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:19.941582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:19.941851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:19.942494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:19.942798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:19.944152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:19.961111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 292/564] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:19.961111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:19.975979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dbf57-335e-4bcf-b25a-56d202f9e0ee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.010993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.011551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.011826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.012095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.022142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.023575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e64674a7-e83f-4d9c-ba09-c45257d372ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:20.039524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:20.041693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:20.041693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:20.041693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:20.042246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 273/565] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.043441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.043732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.044007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.061261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:20.062432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:20.068431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b373e-2613-48a6-a4c4-0f6aa79d3e21 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.069971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.103929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.104534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.104844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.105119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.105764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.106071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.107440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.118692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 293/566] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.119483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.134701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.138223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 274/567] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:20.139065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.240152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8682c-d0f0-494a-b62b-365d66b38e57 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.241401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2e807-4dfc-4eaf-99da-23c43b746cb1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.275333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.275871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.276157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.276433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.281906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.282934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.283373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.283822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.284697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.285010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.285371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.286405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.287124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.298923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 275/568] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.299747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:20.302367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.303354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:20.304386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:20.307675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.308272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 294/569] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.309125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.382480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.406163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09e8e-4b76-4de8-999e-a542c2a83fcf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.421562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74ddf-9426-413a-8e3a-7710528d0cd4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.439352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.439987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.440268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.440539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.448759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.450192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.454645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.455261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.455540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.455808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:20.461274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.462219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 276/570] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.463196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.468430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:20.473908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.474880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 295/571] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.476554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.528004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.566741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef8682-1023-49f4-ab7f-6fb74bb8d246 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.573456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f249f-0bcd-4515-bb06-dd5b5f909b93 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.600081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.601342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.602056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.602399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.602737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.608117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.608763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.609049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.609327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.609424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.610054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.610364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.610806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.611762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:20.622011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.622916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:20.623842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 277/572] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.624396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.630135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 296/573] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.631147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.729130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb215a4-f63a-4f5b-a63b-f5a859ad7079 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.732520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81971-a39f-4ebe-9414-06722c669643 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.753866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.762577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.763185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.763460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.763734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.764444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.764776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.766117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.766235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.766746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.767031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.767307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.778086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:20.782993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 297/574] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:20.783259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:20.784151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:20.785545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:20.786202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.786274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 278/575] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:20.786274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.832355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:20.883444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba163f6-9768-4303-91cc-61d106b9a68d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.886141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd113241-4b23-4a64-b3d6-b86581399784 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:20.916503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.917123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.917411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.917684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.918372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.918678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.918768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:20.919359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:20.919640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:20.919912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:20.920168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.920558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:20.920888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:20.922219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:20.929812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 298/576] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.931102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.937097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 279/577] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:20.937901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:20.979784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.032911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367812a4-ef48-4ace-9933-15cadd63cc7d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.035519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f84822-508e-4b65-86bc-bb7ad90fe841 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.039599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.065820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.066442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.066725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.067004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.068091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.068748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.069028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.069296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.077223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.078650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.079015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.080423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:21.093028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.094175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:21.095295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:21.095295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.095295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:21.095763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.101484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:21.103482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:21.103482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.103482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:21.103482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 280/578] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.103774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 299/579] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.103858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.103948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.193134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.200092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08664b-ae8e-47e4-a669-ce3bbd503e12 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.204973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fa1a-9846-4077-a268-1dcecda606a7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.233923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.234523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.234800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.235067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.235717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.236020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.237400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.239671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.240292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.240588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.240877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.245030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 281/580] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.245802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.251855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.253340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:21.267782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.268783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:21.269701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:21.269701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.269701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:21.269701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 300/581] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.269701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.284482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.346505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21615a4-844f-4a01-a5c1-87d1f517dccb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.371343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fb66-0105-4f94-a278-5ab46ae5a09b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.379404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.380002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.380283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.380555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.381282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=10878995ca2b405e975f1929d737a2ba) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.381587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.383002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.389019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 282/582] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/role_assignments?user.id=10878995ca2b405e975f1929d737a2ba&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.389799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.413851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.416670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.417309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.417591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.417868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.418740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.419509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.420975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.439055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 301/583] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.439055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.510196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386ecc5-348a-476a-a5f8-87a63b91fa04 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.517688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.549729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.550269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.550549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.550820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.551470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.551580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76edb31-2489-4b8f-b6d2-b8425e682227 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.551775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.553342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.567016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 283/584] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.567608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.596179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.596947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.597149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.597435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.609882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.611348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:21.626934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.633569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:21.635272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:21.635272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:21.635272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:21.635272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 302/585] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.635272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.664075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.687403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb688be-dfff-4e02-818e-3386d17ba228 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.725728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.726450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.726793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.727118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.728369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.728793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.730220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.733512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3e793-29bb-4bbf-b89b-3afff1ca55d8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.741705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 284/586] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.742554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.761804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.773824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.775247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.775369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.775730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.782548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.784060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:21.799435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.800531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:21.801673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:21.807842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 303/587] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.807842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.855141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35c09-1c7b-48c5-8c6c-fe80f2356844 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.898504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.900006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.900352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.900964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.908603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.910051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.910717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd2c0-1369-4cec-a9db-7cdbf656c9c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:21.912609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:21.923077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:21.923990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:21.924911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 285/588] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:21.926121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:21.948719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:21.949331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:21.949614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:21.949888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:21.950855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:21.950855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:21.952170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:21.965335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 304/589] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:21.965902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.011656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.037738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd242f1-7425-4c12-812c-b11dd378a1a0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.070724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162cbe-564d-4bde-b83a-ab36fe1f015f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.072987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.073622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.073910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.074180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.081872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.083325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:22.094636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:22.096049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:22.097423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:22.100644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 286/590] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:22.101403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.111542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.112258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.112672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.113042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.113824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:22.114212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.115708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.127508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 305/591] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:22.128486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.169712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.216059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33926-e194-4de4-8d5c-11f4e8751a6f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.239933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68f1aa-94c6-4be9-817a-93f1fa046581 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.241722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.255085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.255710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.255993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.256269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.257005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:22.257314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.259252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.274828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 287/592] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:22.279651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.284064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.284807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.285159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.285502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.294688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.296188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:22.308585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:22.309700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 306/593] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:22.310643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.391196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeffc-3340-4f83-8c4f-d03dea320c22 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.413420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.418228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74234-1a6e-4790-a98e-79f27e4f0a8e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.427837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.428586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.428974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.429346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.430159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:22.431089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.432655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.450195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 288/594] 10.222.0.30 () {56 vars in 1139 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:22.451162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.457176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.457955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.458333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.458700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.475077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=6d7cab58d5cc49469cf0ba0180f19100, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.476508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.490389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 307/595] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:22 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:22.491543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.511222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.584064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac40e2-02ca-4b92-a203-800d66838f66 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.615229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e68cf-e61d-4405-a463-f3d671d991d4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.637274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.640221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.640728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.641185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/572694e1f16040bea41fa0445501d01e/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.658397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.658930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.659206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.659472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.660206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:22.660509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.661971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.674529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=572694e1f16040bea41fa0445501d01e, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.676250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.692161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 308/596] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:22.692161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.693576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 289/597] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:22 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/572694e1f16040bea41fa0445501d01e/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:22.700838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.744957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.783431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:22.864685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943197e-d623-4efd-963d-04a03a9d0dbb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.874749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8206c-fd05-459c-b237-3b5824ae5101 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:22.908723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.910416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.911178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.911904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.927149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.929023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:22.950786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:22.952014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:22.953053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:22.953053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:22.953053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:22.955083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 290/598] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:22.960347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:22.964389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:22.965392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:22.966124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:22.966910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:22.985168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:22.986844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:23.002527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:23.003727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:23.004900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:23.004900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:23.004900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:23.006359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 309/599] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:23.012437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.096845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.125789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a4a1d-9e99-442f-a710-ca095d279cb1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.171072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.171609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.171886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.172156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.172828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:23.173130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.174493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.201199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 291/600] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:23.206803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.222475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619a5f7-6a13-4fdc-b4ec-2a713ba00a49 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.282654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.299606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.300624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.301130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.301600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.302438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:23.302937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.304629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.320430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 310/601] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:23.327185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.375439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397898-b832-4c44-8b40-3b080b0208cc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.453389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.453972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.454255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.454531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.462644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.464055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.465342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbaaa-f96c-48d6-95e6-5a83dce2ebce None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.478280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:23.497319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:23.498234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:23.499117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 292/602] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:23.507061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.518117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.519165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.519711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.520195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.529272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.531102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:23.546181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:23.547162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:23.548037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:23.550666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 311/603] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:23.557618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.653099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.700109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dcdff-4481-4090-a1d6-6e5aba48751f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.717307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6d68a-2e8a-4429-a162-03083b7afe66 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.746453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.747531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.748346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.749109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.750013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:23.750527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.752175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb819aa8-f177-4a00-8d5c-3c7f4455a619 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.752462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.753110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.753387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.753658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.754339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:23.754642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.756032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.769299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 293/604] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:23.770995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7004-1dab-4b4f-9036-9104c6fada78 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.771504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7004-1dab-4b4f-9036-9104c6fada78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.772011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7004-1dab-4b4f-9036-9104c6fada78 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.773959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 294/606] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:23.774152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 312/606] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:23.775057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.776593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7004-1dab-4b4f-9036-9104c6fada78 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:23.857563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.886993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8df5f-66b2-4736-95e8-4e837dbd141c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.888723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:23.918215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7004-1dab-4b4f-9036-9104c6fada78 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:23.926750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.927413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.927686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.927957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/71c93648e7be470794a3282fd043c195/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.943455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=71c93648e7be470794a3282fd043c195, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.944894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995842-46c5-4505-b0cd-a3f6853c0651 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:23.962438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 313/607] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:23 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/71c93648e7be470794a3282fd043c195/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:23.963752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.964041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.964329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.966241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:23.967225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:23.967916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:23.968401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/4fdc7998a54c420c920fc0e54b91b930/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:23.984692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:23.986023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:23.988143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=4fdc7998a54c420c920fc0e54b91b930, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:23.991592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:24.015281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 295/608] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:23 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/4fdc7998a54c420c920fc0e54b91b930/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:16:24.085354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 314/609] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:24.413165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:24.538651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de900-0a23-4015-a49c-9e3ce0379b14 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:24.554703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:24.589392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:24.590038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:24.590315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:24.590587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:24.607138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:24.612042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:24.613007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:24.613846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 296/610] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:24.619109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:24.706300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:24.728027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379dce-f73e-4abc-b0ff-f9a9e23141f3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:24.763159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:24.763766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:24.764041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:24.764353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:24.765046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:24.765342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:24.766747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:24.775470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 315/611] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:24.782067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:24.915243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583c5fa-8f1b-4d32-9329-eee015b77f55 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:24.955954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:24.957036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:24.957548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:24.958031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:24.969391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:24.971398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:24.986779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:24.987773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:24.988722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:24.988722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:24.988722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:24.990773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 297/612] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:24.996718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.148814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979595c3-9f22-434b-a37e-775dc67dc27a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:25.194166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:25.195132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.195410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.196346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.197036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:25.197338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:25.198689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737abd-992f-4749-bb4d-0d4e0be09d90 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:25.222265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 316/613] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:25.227964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.250335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76b43-8233-4162-8ebd-28454d2c64a8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.250672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76b43-8233-4162-8ebd-28454d2c64a8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.250885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a76b43-8233-4162-8ebd-28454d2c64a8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.252198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 317/614] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:25.254820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bdea-e640-469b-a395-d19cd29229df None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.255100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bdea-e640-469b-a395-d19cd29229df None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.255372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bdea-e640-469b-a395-d19cd29229df None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.256550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 318/615] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:25.262383 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b8c8-09e9-45ac-8529-bf237ca9af5c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.262663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b8c8-09e9-45ac-8529-bf237ca9af5c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.262936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b8c8-09e9-45ac-8529-bf237ca9af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.265932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:25.272997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:25.285206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d58b8c8-09e9-45ac-8529-bf237ca9af5c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:25.285750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d58b8c8-09e9-45ac-8529-bf237ca9af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:25.356625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 319/616] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:25.357959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.358256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.358837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.374059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1cb6-dd96-4a95-9c63-75467deef812 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:25.377569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:25.378359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:25.424010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:25.425091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.426017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.426500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.435752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:25.438073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:25.451373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:25.452323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:25.453325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:25.455881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 298/617] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:25.461734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.526253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 320/618] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:25.589793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:25.620818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb05-b940-453e-b4b5-8dfbd7c1584b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:25.663326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:25.663933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.664210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.664478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.665304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:25.665611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:25.667138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:25.685554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 299/619] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:25.690948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.707803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.774810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:25.818168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31ba9-37e4-4bda-9010-ba955888b4ca None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:25.857978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:25.858874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.859345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.859864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.871848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:25.873485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:25.885259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0807e-e17e-4eab-b878-12eef86f11af None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:25.891584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:25.892779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:25.894007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:25.894007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:25.894007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:25.895771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 321/620] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:25.896729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:25.926633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:25.927515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:25.927896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:25.928261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:25.937060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:25.941081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:25.947695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:25.948869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:25.949783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:25.950465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 300/621] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:25.955424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.022965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044895-9557-4274-a6b2-e99986f88ad6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.045677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.070288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.071359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.071634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.071901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.081635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42708b-ddec-48ef-923b-8a030896e078 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.089543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:26.097620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:26.098606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:26.099469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:26.103250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 322/622] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:26.104517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.124321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.125096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.125475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.125837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.126607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:26.127001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.128533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.140962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 301/623] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:26.141950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.202933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.224485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43165f7b-9b4f-44fa-9733-5dd2f1bb771a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.246580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae234b-dda5-42d0-ba5d-42d5759c521a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.262358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.263284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.263818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.264248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.265185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:26.265652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.267165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.277571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 323/624] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:26.278755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.288346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.289327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.289922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.290413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.291288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:26.291791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.293954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.311420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 302/625] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:26.313062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.332929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.401134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951699b-7b9a-4684-b1ad-2b8078a92d08 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.432020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c925-b79a-4cf6-be10-e3409fa41478 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.438681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.439676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.440175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.440686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.448241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.450176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.455446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:26.464982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:26.465898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:26.466784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:26.467850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.468482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.468835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.469185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.474626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 324/626] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:26.475687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.480771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.482332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:26.497802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:26.498782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:26.500067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:26.500067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:26.500067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:26.500067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 303/627] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:26.500067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.580704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.586568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5179a-4a04-4451-9db1-50f6cfdb4646 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.611454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc5a3-d8d0-4112-94b4-a28d8191f5cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.627489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.628595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.629096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.629606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.645018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.646836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.650888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.651503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.651782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.652054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.652790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:26.653149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.654627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:26.665894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:26.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:26.667739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:26.667739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:26.667739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:26.674076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 304/629] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:26.674076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.674500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 325/629] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:26.675524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.719324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.789640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c387a9-b952-4f90-b4f0-aa1bf71d8eb0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.790222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b36dd-cccb-41a8-aac3-3538545a61b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.822907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.823392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:26.823565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.823845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.823991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.824110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/10878995ca2b405e975f1929d737a2ba/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.824272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.824547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.825212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:26.825627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.827004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.838653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 305/630] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:26.839204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.842994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=10878995ca2b405e975f1929d737a2ba, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:26.844424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda26b5-02fd-40c2-a530-541552f86ce3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:26.854690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.859219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 326/631] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:26 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/10878995ca2b405e975f1929d737a2ba/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:26.860888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07038-301d-4372-9cbf-263f46af037a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.861803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07038-301d-4372-9cbf-263f46af037a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.862140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07038-301d-4372-9cbf-263f46af037a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.864337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 327/632] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:26.865928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2af64-1b17-4eda-a1c5-c62b53fc3f54 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:26.867012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2af64-1b17-4eda-a1c5-c62b53fc3f54 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:26.867349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2af64-1b17-4eda-a1c5-c62b53fc3f54 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:26.869101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 328/633] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:26.869642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2af64-1b17-4eda-a1c5-c62b53fc3f54 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:26.958332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:26.967366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a374d-ceb0-4f31-886e-4ce94262ad05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:26.984297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2af64-1b17-4eda-a1c5-c62b53fc3f54 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.004413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.005076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.005360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.005635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.006283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:27.006596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.008006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3feda-3ade-4a99-9ca5-d58999242028 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.026987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.027772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.028053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.028326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.030436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 306/634] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:27.031721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.034944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.035814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.044308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.046313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.058721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:27.059915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3ee4bcf0-9cf0-4bb6-946e-b4163d3b2a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:27.060845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:27.061808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:27.062775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 329/635] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:27.063414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.064024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.064024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.082610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:27.083798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:27.136674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 307/636] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:27.136674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.147372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.159658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 330/637] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:27.160513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.237662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.264291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1702184-5cbb-41bc-aec9-dab921ba9b4e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.325937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.326572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.326851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.327123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.334842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.336506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:27.349714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:27.350712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:27.351674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 308/638] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:27.362345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.382201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0545f-e769-45e1-867f-bf46e9658277 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.435430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.436000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.436280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.436559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.437313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:27.437620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.439044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.462030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 331/639] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:27.462929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.482720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198911da-5cae-493a-b679-94f60bd20f38 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.514456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.520416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.521217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.521500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.521779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.522503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:27.522818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.524881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.542780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 309/640] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:27.543589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.546124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.574058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527271-fe1d-4c16-8b48-7a749138aed3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.615582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.616219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.616529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.616852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.627908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:27.632972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:27.635082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:27.636258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:27.639692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 332/641] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:27.640557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.664217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7c3a6-2a7d-4466-bcee-d38fdd774331 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.708274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.709401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.709853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.710840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.745295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5732-23e1-4290-a196-c5523e612946 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.754999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.783900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.784533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.784846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.785120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.786381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:27.787846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:27.790297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:27.799398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:27.804704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:27.808759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 333/642] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:27.809705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.908378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 310/643] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:27.909302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:27.918073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cc7fe-534c-4285-b27d-bb45d719f9bf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:27.954750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:27.955352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:27.955633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:27.955904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:27.990949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.015839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1abcd-0aee-4ec0-8555-6fbd03111e45 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.017387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.027761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.029437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.052009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.052734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.053084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.053425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.054159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.054565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.056054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.068492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 311/644] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.068492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.135776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 334/645] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:28.136866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.177448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ff463-b1d5-426c-8b34-ab66a0a85962 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.213848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.214053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.214966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.215363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.215761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.216651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.217059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.218601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.227529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 312/646] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.228387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.255152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509379ff-1b26-4c9a-9045-abc360ddbe1f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.256202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.292911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.293852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.294140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.294563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.305416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.306863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:28.322767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:28.324018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:28.325270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:28.325270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.325270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:28.330439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 335/647] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:28.330439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.336633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8bf5-9a1b-4f3c-a39f-6740196d6573 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.374208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.374833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.375118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.375395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.386640 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.388165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:28.403344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:28.404548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:28.411012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:28.411012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.411012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:28.411012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 313/648] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:28.411012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.440977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d62c6-94c4-4e32-8580-1b386a3171ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.462278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.477815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.478540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.478893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.479230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.490391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.491934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.494031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:28.507172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:28.508415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:28.509555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:28.509555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.509555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:28.509923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 336/649] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:28.510655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.523042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a787-8c8d-47c5-8725-a00ba2368438 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.558435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.559071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.559356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.559628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.570818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.572279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:28.587754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:28.588783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:28.589881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:28.589881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:28.589881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:28.589881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 314/650] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:28.590118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.626262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a399d-2795-4fab-b283-364b8b439401 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.662627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.663235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.663513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.663783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.665008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.665312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.666658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.683802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 337/651] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.683802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.702351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093056fa-3d3b-4081-a329-28c6c72439ec None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.719574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.736493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.743244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.744008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.744391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.744791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.745541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.746259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.747493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.764159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 315/652] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.764159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.799174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4bf7b-69cd-4207-8045-0205c59916b0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.836130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.837420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.837641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.837908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.838548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.838848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.840212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.851827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 338/653] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.852651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.879047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c628bda-d480-4375-bb66-764256cafab8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.925927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:28.926547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:28.926831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:28.927102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:28.927741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:28.928045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:28.929451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:28.940698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 316/654] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:28.941499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:28.950913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:28.960974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d0bc-43d8-4e35-80f9-61f009a8854b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:28.999868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.000535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.000853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.001138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.003400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.009491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.010948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:29.022649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:29.023541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:29.024506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:29.028882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 339/655] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:29.030090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.063506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b85d-d97f-453c-8b1b-df7db4b7b948 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.102688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.103342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.103615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.103892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.111424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.112884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:29.124500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:29.125522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 317/656] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:29.126466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.145551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cba13-ed80-49af-a480-e0e5276557f5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.184394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.185068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.185462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.185604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.192964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.194405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:29.205445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:29.206530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 340/657] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:29.207912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.223222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.226157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32789d2-4095-41f3-9400-3de8dfaa2023 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.236489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.260532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.261187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.261464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.261731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.269688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.271151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c7644b2c-ee58-4bbf-b3ea-bd38363da315 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:29.282815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:29.283920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 318/658] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:29.285120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236bfd-5294-465c-a08f-35d9e14921a8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.285942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236bfd-5294-465c-a08f-35d9e14921a8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.285942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236bfd-5294-465c-a08f-35d9e14921a8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.288604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 319/659] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:29.288604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8236bfd-5294-465c-a08f-35d9e14921a8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.312105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a85ae-47d0-4c7a-8d0b-c512650862e1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.345352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.345953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.346234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.346508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.347190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.347492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.348934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.360697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 341/660] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.361322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.392035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8236bfd-5294-465c-a08f-35d9e14921a8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.424489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.425192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.425543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.425814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.426536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.426839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.428254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.428987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.446395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 320/661] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.447265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.461143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74c48-db83-4e84-83de-593d14c5a480 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.476309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.496172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.496802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.497083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.497412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.498088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.498385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.499814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19e6d-e422-42ac-90be-00ab0dc3384e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.511906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 342/662] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.513051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.513338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.513610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.531055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:29.532521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:29.550711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2a0a3-4914-4d49-b8f6-f6f85a95ed16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.583674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.584276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.584554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.584862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.585579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.585883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.587855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.597972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 343/663] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:29.598786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.609268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 321/664] 10.222.0.30 () {56 vars in 1139 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.609268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.667298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.699043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.708550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e686-eede-40b0-8a01-8062c9cf216c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.715176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7410-9fb8-4675-8cf6-4576dfa9b5b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.744149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.744861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.745219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.745565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.746360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.746737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.748223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.750744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.751429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.751775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.752112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.764914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 344/665] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.764914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.851806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.853393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.882445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4c700-74e8-4594-82e9-a3bb66ce13fd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:29.912373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.923590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:29.924266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:29.924598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:29.925025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:29.925645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=572694e1f16040bea41fa0445501d01e) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:29.926147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:29.927418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:29.940620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 345/666] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/role_assignments?user.id=572694e1f16040bea41fa0445501d01e&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:29.940620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:29.967570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:29.997554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 322/667] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:29.998798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.085026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eed354-44c5-40eb-837a-bf3a8b0439af None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.124533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c761e2-fcc6-42a3-8fdc-ba2cb1f21915 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.128069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.128888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.129314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.129762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.165705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.166409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.166688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.166961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.179404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:30.184301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:30.185280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 323/668] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:30.188385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.204108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.220344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.222081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.248858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.325072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869962f-7a37-44b7-91c3-164f367e6878 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.347641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 346/669] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:30.349295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.364857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.365495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.365773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.366043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.376409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.377968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:30.395301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:30.396311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:30.397233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:30.397233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.397233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:30.400844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 324/670] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:30.401770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.456860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.475138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a649d-d10a-4842-b606-b2770b5f768c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.513193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.513796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.514145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.514324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.514983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:30.515284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.516753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.525086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 347/671] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:30.525884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.537864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.543564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb2f5-b94c-4f0a-ad1a-59860d2fde09 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.590500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.591673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.592505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.592959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.607658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.609869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:30.628643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:30.629609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:30.630616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:30.630616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.630616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:30.632642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 325/672] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:30.634424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.644178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4b1d-fef2-4642-8ded-1d87a08b5877 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.680272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.680973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.681326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.681668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.682374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:30.682743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.684241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.696722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 348/673] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:30.702203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.717358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.771583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ce7b-69d8-4ec6-b9df-d32ba2890b6a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.812439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9bc-1d3a-4ad3-bf88-e57103aac5b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.818876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.819821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.820265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.820758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.836915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.839149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:30.858553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:30.859748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:30.860753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:30.860753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:30.860753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:30.860924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 326/674] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:30.862090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.863474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:30.864259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:30.864717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:30.865650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:30.865998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:30.869511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:30.870167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:30.871705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:30.887653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 349/675] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:30.889157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:30.974952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338c2f-ea72-4b0e-9271-719719f407dd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:30.980704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.011411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a51e86-2673-436a-a492-d178f981259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.012307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a51e86-2673-436a-a492-d178f981259b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.012714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a51e86-2673-436a-a492-d178f981259b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.013319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a51e86-2673-436a-a492-d178f981259b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.019573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c1e95-51fb-4f9a-bb8d-62164fc39603 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.020223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a51e86-2673-436a-a492-d178f981259b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.021896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a51e86-2673-436a-a492-d178f981259b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-00a51e86-2673-436a-a492-d178f981259b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:31.034393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:31.035476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:31.036620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:31.043180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 327/676] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:31.044326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a51e86-2673-436a-a492-d178f981259b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.064543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.065697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.066123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.066551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.067329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.067783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.070028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.085941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 350/677] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:31.086948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.110913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.159906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a51e86-2673-436a-a492-d178f981259b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.210509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.211067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f014-63d7-4f32-8d98-eb28519dda18 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.211203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.211472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.211747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.220317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.222157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:31.237138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:31.238082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:31.238984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:31.239414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 328/678] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:31.240487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.244742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.251835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.252779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.253255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.253767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.254667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.255236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.257059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.271713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 351/679] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:31.272949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.354815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870af4a-534d-4918-981b-f7fc8dd3832a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.380292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.398884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.400399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.400930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.401542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.405414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78cc0-1ea6-4b93-8a7b-e1787b13448d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.411382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.413477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:31.430539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:31.431540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:31.432579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:31.436900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 329/680] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:31.437955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.459524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.460765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.463641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.464107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.465019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.465528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.467711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.487344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 352/681] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:31.488539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.555723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.579747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7623-4479-4e52-8f8d-fb0e7a6cd03e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.614524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa2844-f51b-4e98-b251-6d1599abc858 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.623810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.624699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.625185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.625771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.626683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=4fdc7998a54c420c920fc0e54b91b930) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.627300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.629468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.639700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 330/682] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/role_assignments?user.id=4fdc7998a54c420c920fc0e54b91b930&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:31.641505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.656928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.657544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.657820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.658094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.658831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.659170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.660609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.687791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 353/683] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:31.698993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:31.722546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.815198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e708-e8fc-483b-b837-093f7dd34721 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.833042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:31.857425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.858050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.858331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.858606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.906618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9bb0d-fa70-43b0-ba5a-d493e0b74865 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:31.936613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.938157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:31.982801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:31.984097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:31.984779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:31.985678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:31.988548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=71c93648e7be470794a3282fd043c195) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:31.989523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:31.992852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:32.009381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 331/684] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/role_assignments?user.id=71c93648e7be470794a3282fd043c195&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:32.072526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 354/685] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:32.080712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:32.210379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d09-8467-42d5-a924-c019acf58f4a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:32.226349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:32.255095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:32.255758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.256037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.256309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.269624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:32.271180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dc8ab6f7-6312-4120-ae79-f731b0dc6c40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:32.289719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:32.291270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:32.292762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:32.292762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:32.292762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:32.292762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 332/686] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:32.302361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:32.323081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:32.383088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a74e-9010-45d6-9ab3-5f134e0e3126 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.383398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a74e-9010-45d6-9ab3-5f134e0e3126 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.383632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a74e-9010-45d6-9ab3-5f134e0e3126 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.384987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 333/687] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:32.391898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882bc07-2c46-4d37-ae74-c9ed6e2a2a49 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.392303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882bc07-2c46-4d37-ae74-c9ed6e2a2a49 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.392724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882bc07-2c46-4d37-ae74-c9ed6e2a2a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.423202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4882bc07-2c46-4d37-ae74-c9ed6e2a2a49 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:32.424766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4882bc07-2c46-4d37-ae74-c9ed6e2a2a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:32.430708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ce8a-d8e6-43c6-bc3c-2b0c8df4f7ca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:32.483354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:32.484190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.484592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.484991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.485967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:32.486399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:32.488380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ffbb1-5cad-41c5-abe2-da18a8793b67 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:32.510076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 355/688] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:32.511713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ed58-b1f7-4268-b1ac-cc6f4168f80e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.512002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ed58-b1f7-4268-b1ac-cc6f4168f80e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.512278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ed58-b1f7-4268-b1ac-cc6f4168f80e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.514458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 356/689] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:32.516337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1ed58-b1f7-4268-b1ac-cc6f4168f80e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:32.528688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 334/690] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:32.530410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.530904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.531432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.561636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:32.563169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:32.611093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:32.673561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1ed58-b1f7-4268-b1ac-cc6f4168f80e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:32.699182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 335/691] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:32.722593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:32.723232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.723511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.723783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.731323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:32.732771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:32.744326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:32.745246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:32.746796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 357/692] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:32.753655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:32.791450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:32.841896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:32.889045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074cea-059a-4a3b-8d34-363fbc549c95 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:32.925810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:32.926430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:32.926710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:32.927003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:32.927791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:32.928099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:32.930262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:32.942632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 336/693] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:32.951736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.042355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2e1e-23a7-4961-b3ec-fa7a17efd45e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.068935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.079313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.088505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.089362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.089785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.090203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.095254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f61b1-36a2-4e67-ba07-c1a0161834aa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.103931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.105716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:33.123187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:33.124419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:33.125530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:33.125530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:33.125530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:33.126025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 358/694] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:33.126695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.139454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82370-6788-4849-b525-4da55e15846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.140103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82370-6788-4849-b525-4da55e15846f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.140801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82370-6788-4849-b525-4da55e15846f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.141097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82370-6788-4849-b525-4da55e15846f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.141832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82370-6788-4849-b525-4da55e15846f None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=10878995ca2b405e975f1929d737a2ba) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:33.142153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82370-6788-4849-b525-4da55e15846f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.143603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82370-6788-4849-b525-4da55e15846f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.150467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 337/695] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:32 2022] GET /identity/v3/role_assignments?user.id=10878995ca2b405e975f1929d737a2ba&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:33.151259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82370-6788-4849-b525-4da55e15846f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.252427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44192-9741-4f06-941d-4cc9d85c53d5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.261216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82370-6788-4849-b525-4da55e15846f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.316416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.317007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.317285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.317554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.329553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.330180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.330459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.330726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.331376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:33.331676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.333103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.342229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:33.353777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:33.354961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:33.355931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 359/696] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:33.363002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 338/697] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:33.369711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.371291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.391488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.438139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.516200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758faa0e-2391-4011-8fab-6c925135718b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.527415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352237b0-4d53-4754-9ca4-ec93026ee1e9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.552131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.553034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.553457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.553898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.555905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.557521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.565887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.566766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.567079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.567473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.568294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:33.568733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.570400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.580430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 339/698] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:33.582635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 360/699] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:16:33 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:33.586259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.664021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.701831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca34a7b-d6af-474a-97de-fff4d6a3c8ad None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.739672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.740464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.740879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.741270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.753721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.755331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:33.771536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:33.772811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:33.774111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:33.774111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:33.774111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:33.775762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 340/700] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:33.781076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:33.893693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07826-a023-49bf-aab4-e1b897cc60c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:33.896753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:33.936893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:33.937623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:33.937975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:33.938247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:33.938895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:33.939195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:33.940550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:33.953300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 361/701] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:33.958940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:34.072248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4768d-ce42-4fa6-a7be-75678e8bc3ac None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:34.093621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:34.113905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:34.114546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.114888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.115215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.128519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:34.130039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:34.144607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:34.145610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:34.147257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 341/702] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:34.151414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:34.290899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcd278-9ddb-433f-a898-c9a4e9f60c96 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:34.340003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:34.340646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.340932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.341205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.341934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:34.342286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:34.343741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c3bfc-37b1-4505-b64f-b8a6bc0ffde9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:34.372488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 362/703] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:34.378264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:34.545877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af23b1-0e37-4eba-8f61-40f07ba915ce None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:34.592857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:34.593479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.593758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.594033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.656636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304541-465d-44e8-8071-309f3b02d327 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.656960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304541-465d-44e8-8071-309f3b02d327 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.657206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304541-465d-44e8-8071-309f3b02d327 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.659036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 363/704] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:34.660545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:34.664537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.665357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.665843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.682627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:34.686233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:34.709245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:34.711766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:34.750046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:34.793957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 342/705] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:34.799407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:34.856209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 364/706] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:34.901071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:34.923898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e585cd-d361-4564-880f-d0c4bf4a2a2d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:34.958685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:34.959323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:34.959598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:34.959865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:34.970505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:34.971940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:34.987150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:34.988117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:34.989060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:34.989060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:34.989060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:34.989060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 343/707] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:34.994145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.125130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ceab0-d16c-45ed-bae8-e259e680f516 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.160556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.176179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.176873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.177139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.177411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.180874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:35.181187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.185111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749441-9aff-4de7-9276-8bacb961cf96 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.213032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 365/708] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:35.214777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbbde-753c-4e48-9632-822c41879d7c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.215173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbbde-753c-4e48-9632-822c41879d7c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.215553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbbde-753c-4e48-9632-822c41879d7c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.217600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 366/709] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:35.221069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cbbde-753c-4e48-9632-822c41879d7c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.230638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:35.284299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5f9cf-2394-4391-bd0b-e6cc27140f0a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.317021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:35.321537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.322611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.323116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.323666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.324492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.326316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.334082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cbbde-753c-4e48-9632-822c41879d7c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fdb71b41-9c32-4692-bb0d-1a0d5c64c33a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:35.339964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:35.341070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:35.341962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:35.345453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 344/710] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:35.347181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.347801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.348636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.370474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.371089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.371370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.371644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.372368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:35.373955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:35.379891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.381294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:35.395799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:35.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:35.397666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:35.400690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 367/711] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:35.402008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.453001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 345/712] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:35.454582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.484583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:35.546234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179048-bafb-452a-8485-56c8dda3ef17 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.593924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d7f0-e5c7-4c10-baf3-17742346e5ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.602683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.603626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.604115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.604614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.605470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:35.605976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.607535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.622063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:35.623696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 368/713] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:35.628969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.635993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.642623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.643077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.643516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.644351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:35.644860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.646463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.669017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 346/714] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:35.686336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.760526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ebf4c-daf0-450d-9604-bb72c2ab5249 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.792426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:35.799679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.800297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.802165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.802165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.802165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:35.802165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.803606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.816603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 369/715] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:35.816603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:35.926411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944eba-c9fc-4eff-b21c-ae4f90b9dcad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.965568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:35.966229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:35.966517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:35.966796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:35.967913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:35.969545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:35.982586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:35.983858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:35.985054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 370/716] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:35.988378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4bc9-bc81-4501-8b77-45c869a9c98a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:35.989677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:36.076945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:36.096065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:36.098121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.098561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.098976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.099842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:36.100325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:36.102007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:36.108187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 347/717] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:36.129457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe63b9-651c-4f05-8155-53a2766a8516 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:36.171384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:36.172013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.172295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.172588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.173239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:36.173547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:36.174921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb4ec-2b96-41a6-846e-a6eccf00fb0c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:36.189611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 371/718] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:36.195850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:36.296584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:36.348987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a68-ba0f-4714-b130-110ac0eedb14 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.349361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a68-ba0f-4714-b130-110ac0eedb14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.349744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb22a68-ba0f-4714-b130-110ac0eedb14 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.351924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 372/719] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:36.357629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb294089-e946-473c-be79-34f183a7cd2a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.357919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb294089-e946-473c-be79-34f183a7cd2a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.358187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb294089-e946-473c-be79-34f183a7cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.379764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b8c3-e3d8-4416-be99-14e5e211c3b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:36.381365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eb294089-e946-473c-be79-34f183a7cd2a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:36.383304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eb294089-e946-473c-be79-34f183a7cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:36.418979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:36.419750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.420128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.420497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.421257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] RBAC: Adding query filter params (type=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:36.421652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:36.423163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aafdf8-346b-4013-9c26-78ef92d595cc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:36.436753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 348/720] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:36.472175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 373/721] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:36.673687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840dee-605d-4392-b211-7da0dabe1244 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.674197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840dee-605d-4392-b211-7da0dabe1244 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.674197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840dee-605d-4392-b211-7da0dabe1244 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.675688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 349/722] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:36.681375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.681665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.681935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.704376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:36.705577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:36.770724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840dee-605d-4392-b211-7da0dabe1244 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:36.777048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:36.798842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 374/723] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 06:16:36.923061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840dee-605d-4392-b211-7da0dabe1244 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:36.937669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:36.957954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:36.958590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:36.958871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:36.959145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:36.970658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:36.975855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:36.976938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:36.977825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 350/724] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:36.984907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.100145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.123599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee1907-c18c-4fb1-a8c4-4e2feee856c6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.186187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.186805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.187086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.187359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.188031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:37.188337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.190559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:37.216787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 375/725] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:37.217695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.269854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:37.276691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d981-1f6a-43eb-8da3-7a653ff06b35 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.312435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.313669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.314146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.314630 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.325895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:37.331473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:37.332416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:37.333305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:37.336482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 351/726] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:37.342338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.347782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc904-2406-4378-b621-3b69715d61cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.382069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:37.426250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.426902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.427181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.427454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.451779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.453246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:37.457521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbd88-79af-45ca-8e46-8692ced83ac8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:37.479590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:37.480621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:37.481532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:37.481532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:37.481532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:37.484698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 376/727] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:37.486054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.497932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.498850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.499324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.499786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.500752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:37.501271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.502942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:37.516926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 352/728] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:37.518623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.619384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:37.626651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634df279-c294-4d41-be9e-cb3223290280 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.689862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:37.698237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79390d04-fc4f-461a-8891-4848e44f0151 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.709277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.709923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.710203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.711043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.735045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.737552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:37.749663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.750265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.750542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.750810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.751507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:37.751811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.754544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:37.767350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:37.768294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:37.769221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:37.769221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:37.769221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:37.770235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 353/729] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:37.774547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 377/730] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:37.776208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.779915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:37.950450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adbb6c-5439-4872-a26c-e29af488c23e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.986975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:37.988229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:37.989216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:37.989719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:37.990576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:37.991076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:37.991731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08ac5-c22a-42bc-86d1-43697e13a46e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:37.993018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.005703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 354/731] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:38.017460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.034512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.058533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.059165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.059442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.059711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.071181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.072624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:38.094206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:38.095480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:38.096431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:38.097882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 378/732] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:38.102147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.138440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.212097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f20e-b4f3-42e3-8633-4c65de1ef1b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:38.273513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.274534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.275115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.275720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.278530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b38a3-d756-4051-9cc1-72d000261e55 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:38.292507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.294174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.314887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.315856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.316358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.316858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.317773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:38.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:38.318845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:38.320319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:38.321419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.323148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.325537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 355/733] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:38.326240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.354963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 379/734] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:38.359216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.438989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.505683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417beda-522b-43ad-be58-01f903db8c65 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:38.578090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.579153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.580412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.580906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.581041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.581832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:38.581967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.583408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b20dd8-abbe-4068-9546-e4619e40b9d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.618362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc93fd-28cc-4bdd-ba13-1d60106f5443 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:38.622808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 356/735] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:38.625849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c30c-22bc-4bbf-85fe-a645927d68f3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.626139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c30c-22bc-4bbf-85fe-a645927d68f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.626416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c30c-22bc-4bbf-85fe-a645927d68f3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.627979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 357/736] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:38.628729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728c30c-22bc-4bbf-85fe-a645927d68f3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.668538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.669417 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.669705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.669982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.742199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728c30c-22bc-4bbf-85fe-a645927d68f3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:38.749014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.750616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d964d6a-2a8c-4033-b761-79a58c1e0cc5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.770402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.779265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:38.779902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.780211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.780444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.835994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:38.857548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:38.859007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:38.869922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 380/737] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:38.871423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183c75-e0b2-4e0d-96de-ff536345a07c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.871846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183c75-e0b2-4e0d-96de-ff536345a07c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.872291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183c75-e0b2-4e0d-96de-ff536345a07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.890866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e3183c75-e0b2-4e0d-96de-ff536345a07c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:38.892086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e3183c75-e0b2-4e0d-96de-ff536345a07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:38.972902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 381/738] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:38.972902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e583b3-d63c-4c28-b0aa-32d57dce23f5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:38.972902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e583b3-d63c-4c28-b0aa-32d57dce23f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:38.972902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e583b3-d63c-4c28-b0aa-32d57dce23f5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:38.973295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 358/739] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 06:16:38.973371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 382/740] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:38.973440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:38.973518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e583b3-d63c-4c28-b0aa-32d57dce23f5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.001011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.082005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687fa11-f2aa-41c3-9561-3970b2ce42fd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.097972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e583b3-d63c-4c28-b0aa-32d57dce23f5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.101302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.118968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.119610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.119888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.120162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.130576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.132022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.136822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.137714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.138210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.138701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-58447a73-6788-4c8a-8cf2-36bb5b502f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:39.146773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:39.148233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:39.149191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:39.149191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:39.149191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:39.149191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 359/741] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:39.149925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.150304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.150633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.155393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.157121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.168643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:39.169818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-caaad389-12dc-4746-9599-431e85a1f2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:39.174950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:39.175898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:39.176829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:39.176829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:39.176829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:39.181226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 383/742] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:39.182464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462fc3-7aa8-49f6-a1ea-bb016712a7e2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.182758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462fc3-7aa8-49f6-a1ea-bb016712a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.183037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462fc3-7aa8-49f6-a1ea-bb016712a7e2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.188156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 384/743] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:39.188156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe462fc3-7aa8-49f6-a1ea-bb016712a7e2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.251784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 360/744] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:39.252660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.263354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.293821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe462fc3-7aa8-49f6-a1ea-bb016712a7e2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.331550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.332222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.332449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.332758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.333759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:39.334073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.336347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67ddb-54ad-4d86-a72d-6d0258a41f45 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.348453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 385/745] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:39.353897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.354183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.354464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.357750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df82f7-7f62-40a4-86bc-d3c570f3d96f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.372343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:39.373562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:39.385793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.392391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.393032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.393350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.393573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.394257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:39.394501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.395879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.411575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 361/746] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:39.411575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.451373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 386/747] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 06:16:39.456750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.489694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.526505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34410430-eb4a-43dc-b376-bc439d5af67f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.562936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.563934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.564473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.564779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.565672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.567748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.569014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db95a4e-d348-4401-bed5-cc9a473d119d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.592782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 362/748] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:16:39 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:39.592782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.628038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.629021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.629512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.630314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.642618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.644520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:39.662423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:39.664057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:39.665053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:39.666074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 387/749] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:39.667092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.672579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.743129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6ceb-5b6f-4d7b-a24e-ee632f13a639 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.774054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.785826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.786546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.786882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.787224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.795231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5274a2-47fd-4fb9-bba8-2244a0554715 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.796845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.798457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:39.810437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:39.811544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:39.812483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 363/750] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:39.813627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.839363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.840000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.840283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.840559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.851245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:39.856395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:39.857579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 388/751] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:39.858546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:39.922647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:39.937240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a756d2-42d2-4f01-8991-c2f425d09e80 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.963878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398323-bc9f-44e9-a06e-2766bc528444 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:39.973664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:39.974276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:39.974557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:39.974833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:39.975547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:39.975893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:39.977383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:39.994800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 364/752] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:39.994800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.005642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.006250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.006532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.006803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.007529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.008917 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.024211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 389/753] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:16:39 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:40.026702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.053438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:40.121161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0e40-0693-4068-890e-bb4e47a7b5e9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.165530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.166158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.166434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.166703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.167633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:40.167752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.169218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.191032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1894b1-395d-4ea4-89c7-9d85eea166eb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.191345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 365/754] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:40.192116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.220499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:40.236680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.237327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.237611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.237893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.238554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:40.238861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.240214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.249884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 390/755] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:40.250634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.323444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811af8-c2a2-4580-8096-cf855fbe2665 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.325917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:40.361001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.361680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.361964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.362239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.363023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=10878995ca2b405e975f1929d737a2ba) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:40.363396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.364873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.370900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 366/756] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/role_assignments?user.id=10878995ca2b405e975f1929d737a2ba&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:40.371868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.374727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6993d55-0c51-457e-b652-283cc4276f83 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.538064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.539193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.539731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.540205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.541288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=a64a8f621ee244ceb531caa37d6cff8f) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:40.541826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.543492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.551396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 391/757] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/role_assignments?user.id=a64a8f621ee244ceb531caa37d6cff8f&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:40.609386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb1467-aad8-45df-b629-d03c021c893d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.666297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.666882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.667166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.667440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.683646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.685301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:40.705426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:40.706451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:40.707360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:40.707360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:40.707360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:40.707360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 367/758] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:40.714230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.773932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:40.828381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddcd7d-57d3-41f5-ab94-8e91f872bb78 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:40.863791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:40.864802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:40.865316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:40.865755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:40.867024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:40.867344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:40.868746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:40.881091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 392/759] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:40.889692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:40.940761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:41.058472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec48f4-f07b-481d-b736-d66becc6470d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:41.102939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:41.103586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:41.103871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:41.104148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:41.115971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:41.117514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:41.128939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:41.129892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:41.130837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 368/760] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:41.138043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:41.302657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc7f3-1bcb-4e39-be95-42acb4a369e6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:41.312107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:41.346329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:41.346939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:41.347226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:41.347501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:41.348232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:41.348543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:41.349973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:41.373134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 393/761] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:41.381030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:41.512846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:41.542432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d036d-25f6-4180-83ed-45c3b9639c35 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:41.588499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:41.589148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:41.589436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:41.589711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:41.604703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:41.606244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:41.627086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:41.628103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:41.629624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:41.629624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:41.629624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:41.629624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 369/762] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:41.634790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:41.777632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9965-3290-4b73-92e7-1c4413557538 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:41.823663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:41.824277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:41.824586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:41.824855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:41.825498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:41.825803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:41.827160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:41.843390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 394/763] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:41.848619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:42.003979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4b3df-2704-4716-a032-88aa7a964be8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:42.042849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:42.047887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:42.048526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.048861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.049192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.061759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:42.063200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-66505ec6-fb7d-4b66-8965-056172ceae29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:42.074444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:42.075309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:42.076796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 370/764] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:42.081166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:42.133749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:42.242743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00844-2266-4b52-a1d5-28ffc2caf49a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.243070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00844-2266-4b52-a1d5-28ffc2caf49a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.243321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00844-2266-4b52-a1d5-28ffc2caf49a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.243522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c202-a20d-434d-b42d-d6aa375089cc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:42.244950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 371/765] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:42.251243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59435a-909d-4959-8780-7d07f5ef27fb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.251605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59435a-909d-4959-8780-7d07f5ef27fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.251930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59435a-909d-4959-8780-7d07f5ef27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.280370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:42.281310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.281759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.282197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.283090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:42.283565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:42.285206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:42.293592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3d59435a-909d-4959-8780-7d07f5ef27fb None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:42.294881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3d59435a-909d-4959-8780-7d07f5ef27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:42.299502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 395/766] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:42.309842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:42.423211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 372/767] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:42.451993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:42.471256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597bb65-abee-4db7-9c8b-7fbcc0e5ee1b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:42.519404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:42.520062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.520341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.520750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.531916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=6d7cab58d5cc49469cf0ba0180f19100, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:42.533370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7883-ba3c-4912-9ade-dbbc4cbd408e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:42.558911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 396/768] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:42 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:42.755850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c4fa-a8e3-4bf5-8e8c-1d1257f14167 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.756589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c4fa-a8e3-4bf5-8e8c-1d1257f14167 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.757156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c4fa-a8e3-4bf5-8e8c-1d1257f14167 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.759052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 373/769] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:42.765163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.765664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.765741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.781958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c4fa-a8e3-4bf5-8e8c-1d1257f14167 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:42.789933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:42.791151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:42.868288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 397/770] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:42.909908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c4fa-a8e3-4bf5-8e8c-1d1257f14167 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:42.936190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:42.948888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:42.949538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:42.949819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:42.950092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:42.950736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:42.952158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:42.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:42.963186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:42.964043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 374/771] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Sep 9 06:16:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:42.969109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.057025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.090560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d3b3b-4790-4946-ac06-42a29a2d158e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.142392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.142993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.143270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.143538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.144163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:43.144464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.145853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.156747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 398/772] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:43.161953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.228130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.290826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2f0c-7161-439a-b6ff-e30941b0c9e1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.331626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.331976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.332263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.332535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.333236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:43.333545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.334951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae8262-0218-4d58-9572-6c04a6e9d75b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.342945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 375/773] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:43.344206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd36d3-7743-4c4f-9862-d0a7231f09b3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.344853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd36d3-7743-4c4f-9862-d0a7231f09b3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.345127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd36d3-7743-4c4f-9862-d0a7231f09b3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.350998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 376/774] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:43.350998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd36d3-7743-4c4f-9862-d0a7231f09b3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.351393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b131069-868c-4919-98ad-947a8ec96ffa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.394850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.395487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.395858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.396030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.396626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.398627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-02d93e09-4489-424b-ac9b-586b61f7d36a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:43.407483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:43.408506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:43.409421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 399/775] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:43.410225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48388-7c2c-4475-baf2-0dace6a3a06a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.410225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48388-7c2c-4475-baf2-0dace6a3a06a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.410368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48388-7c2c-4475-baf2-0dace6a3a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.421674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.421848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.435455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-31d48388-7c2c-4475-baf2-0dace6a3a06a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:43.436678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-31d48388-7c2c-4475-baf2-0dace6a3a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:43.479188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd36d3-7743-4c4f-9862-d0a7231f09b3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.511821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 400/776] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:43.513331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e310-9b96-488f-928a-43d86781a821 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.513618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e310-9b96-488f-928a-43d86781a821 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.513893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e310-9b96-488f-928a-43d86781a821 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.516601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 401/777] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:43.516601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e310-9b96-488f-928a-43d86781a821 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.526295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.527050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.527405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.527750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.528531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] RBAC: Adding query filter params (interface=public, service_id=24eeca9851e2425785914f91a2014605, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:43.528954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.530483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f5f0-650c-46bc-850c-4066d96b4e68 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.543358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 377/778] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/endpoints?service_id=24eeca9851e2425785914f91a2014605&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:43.543358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.543358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.543358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.559727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:43.561070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:43.649210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 378/779] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:43.650200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.653225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e310-9b96-488f-928a-43d86781a821 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.694923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.695859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.696754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.697236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.698197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:43.698864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.700683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.702418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.707481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 402/780] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:43.713454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.832906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a000479-f8ba-478f-9e4f-ab8da1710e7d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.875776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.876775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.877254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.877712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:43.878518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:43.878992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:43.880674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:43.888410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 403/781] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:43.889575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:43.900786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.959519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b6e8-d12e-47ee-9757-6db97f8708d5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:43.973519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:43.997696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:43.998557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:43.998950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:43.999326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.000036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.001720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.015493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 379/782] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/services => generated 772 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.015493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.030287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178916fd-2c4a-45e5-923a-dd129591d0d2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.071685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.072364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.072673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.073019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.085321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:44.090308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:44.091321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:44.092174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 404/783] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:44.092961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.170771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cc31f-f3e3-4ac3-9d62-5c85166fbb6b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.195107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.216339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600486-1e62-48a3-bd2f-b2e509fcbd6d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.227227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.227913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.228193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.228460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.230020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] RBAC: Adding query filter params (interface=public, service_id=0f16e32504b44fe79d7ca557484b5f74, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:44.230331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.231700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.237327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 380/784] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/endpoints?service_id=0f16e32504b44fe79d7ca557484b5f74&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.238135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.242401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.266186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.266816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.267098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.267378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.280925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:44.285774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:44.286916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:44.287869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:44.292513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 405/785] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:44.293260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.383530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9667-c10c-4b6f-a59f-1c5713d3b45b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.412365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ac82-a7b4-47d3-a8ba-48fb0238b6dd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.432262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.433210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.433716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.434725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.435903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:44.436419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.438959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.449452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.450080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.450350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.450606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.451269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.452790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.457485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 381/786] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.458785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.464362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 406/787] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.465473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.526380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.531608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.603676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed39d4d-8839-4c94-b426-609839da4929 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.646654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.647727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.648219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.648726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.662446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.666852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:44.697660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:44.698778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:44.699832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:44.699832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:44.699832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:44.706507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 407/788] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:44.710997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7d76e-400a-4c22-9e88-29db7a790fed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.713534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.754787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.755409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.755689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.755958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.758359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:44.758359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.758359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.771991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 382/789] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.773650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.863689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.870316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbfa85-0be2-469c-a906-d07c86c12785 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:44.907029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:44.912597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:44.925296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 408/790] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:44.934662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:44.958302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:44.965932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193278b-8e27-4ec7-85d3-aa92618f1610 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.067893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253affff-3502-4cae-b5ab-9ad18b6e15c4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.105220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.105858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.106136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.106407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.113787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.113935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.114504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.114787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.115063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.115227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:45.127817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:45.128834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:45.130415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 409/791] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:45.134799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.136956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.139101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1e72803b-6766-4ef8-817f-c8169dd38c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:45.155962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:45.158252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 383/792] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e0e5-a40a-4c51-9ac1-680a92da017f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e0e5-a40a-4c51-9ac1-680a92da017f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.161356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969e0e5-a40a-4c51-9ac1-680a92da017f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.163740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.164713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 384/793] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:45.170764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.171302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.172207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.202823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:45.204334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:45.249809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40262f3-1edd-4d6c-b825-894bf97decf8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.277718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 385/794] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:45.278875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.301306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.301925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.302204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.302476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.303367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:45.303519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.304987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.349110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 410/795] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:45.350875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.415616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.458917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2306-7bc5-466f-a284-a58ce591db2c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.502491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.523487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.524437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.525045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.525511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.526357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:45.526868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.528441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.540466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 386/796] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:45.546234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.554359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84cfe-d010-4b0a-b82f-264a474d0bb7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.629048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.629697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.629981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.630260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.642807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.644681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.656813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855452-ed16-412f-831b-0719aaebe420 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:45.662070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:45.663036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:45.663936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:45.663936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:45.663936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:45.668233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 411/797] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:45.669105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.698515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.699481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.700005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.700617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.708658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.710829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.712776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:45.724453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:45.725535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:45.726512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:45.733431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 387/798] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:45.734670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.786154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0001-3550-41ab-bc55-77bebe0b6286 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.816967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.826036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.826722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.827144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.827548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.840215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:45.846374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf06-88aa-475a-a68e-670ea9e210e4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:45.846684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:45.847605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:45.848448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:45.852801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 412/799] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:45.853628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.887387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:45.888406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:45.889107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:45.889621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:45.890501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:45.891084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:45.892781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:45.906613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 388/800] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:45.907710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:45.972513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:45.979182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995187c4-dd76-48ed-9e53-797babcb07bd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.018663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.019280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.019564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.019839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.020550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d667d-865a-4042-bcea-f03e8437f270 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.020692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:46.020907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.022879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.046870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 413/801] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:46.046870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.064740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.065742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.066215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.066773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.067679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:46.068219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.070521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.080337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 389/802] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:46.081366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.102352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.165775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612fdc-f6ed-4fd6-9a01-6fbd304ab89e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.202775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.203653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.203944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.204221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.208084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d64-afaf-4ff2-9375-f7bf3cb308f8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.212010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.213490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:46.227008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:46.227942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:46.228907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:46.232992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 414/803] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:46.233676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.234340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.251115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.251916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.252287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.252698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.265614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.267257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:46.284590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:46.285678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:46.286615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:46.286615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:46.286615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:46.286615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 390/804] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:46.292883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.355504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b585a6-2c16-402a-8b0b-0819b4f793ec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.364602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.396873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.397595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.397872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.398144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.405246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34a78-cb75-4cf3-9aaf-f2e64d73c163 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.411701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.413594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:46.429707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:46.430864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:46.431969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:46.431969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:46.431969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:46.435375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 415/805] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:46.436144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.443341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.444693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.445085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.445454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.446297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:46.446717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.448295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4549df-71fc-4b36-9bff-76ed08f1e999 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.461006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 391/806] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:46.462178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fb8bc-8b3a-4aa9-b5cb-143e5f073762 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.462561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fb8bc-8b3a-4aa9-b5cb-143e5f073762 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.462935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fb8bc-8b3a-4aa9-b5cb-143e5f073762 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.464370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 392/807] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:46.468955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fb8bc-8b3a-4aa9-b5cb-143e5f073762 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.501650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.546934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe02f60-24f3-4ecd-8db1-ccfde7eaeca0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.576246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fb8bc-8b3a-4aa9-b5cb-143e5f073762 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.583124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.583732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.584017 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.584290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.584993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:46.585297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.586651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.598864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 416/808] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:46.599649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.615510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.616592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.616860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.617132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.617773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:46.618077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.619425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96765d5-fa98-4407-8196-d44526dc200c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.620254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.635486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 393/809] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:46.637124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.637246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.637566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.656332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:46.657605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:46.711419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357384-3e97-4f13-81b8-db1dce246206 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.732599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 394/810] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:46.732599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.758005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.762107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.763359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.763708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.764047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/10878995ca2b405e975f1929d737a2ba/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.766379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=10878995ca2b405e975f1929d737a2ba, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.767859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.783433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 417/811] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:46 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/10878995ca2b405e975f1929d737a2ba/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:46.784542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:46.882468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:46.904866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f743-a0e8-4d72-8413-5f5b5780e5c5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.916257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b082c-f325-43f2-b589-04591aa64ff7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:46.964410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.966046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.966545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.967317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.972896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:46.973707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:46.974095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:46.974583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:46.980106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.982348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.985459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:46.987528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e955bb16-a765-4fc0-af62-ed2222946092 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:46.998773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:46.999815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:16:47.000828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:47.001378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:47.002169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:47.003074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:47.005803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 418/813] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:47.007409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 395/813] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:47.007988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa08c-4335-430d-8515-a413347e4dfd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.008479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa08c-4335-430d-8515-a413347e4dfd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.008626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.009225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa08c-4335-430d-8515-a413347e4dfd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.011050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 419/814] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:47.012357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aa08c-4335-430d-8515-a413347e4dfd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.102387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.125191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a86d4-0f57-403b-bf11-cb8eb7a7538d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.143795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aa08c-4335-430d-8515-a413347e4dfd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.161207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.161823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.162104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.162380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.163663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:47.163976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.165468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248926b-6f85-474c-b6b8-368679c37af6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.179311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 396/815] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:47.179311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.179311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.179627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.193217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.193837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.194182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.194903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.195650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:47.195967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.197614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.200206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:47.201416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:47.207703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.219374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 420/816] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:47.220202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.272465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 397/817] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:47.274108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.356495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f755a-02b0-4980-8150-b86173ce9f46 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.358284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.398579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c3c0-595f-4382-a91b-ca815504c0ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.399029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.400194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.400752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.401230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.402909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.405172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:47.418340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:47.419360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 06:16:47.420210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:47.423993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 421/818] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:47.425270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.436440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.437109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.437391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.437654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/a64a8f621ee244ceb531caa37d6cff8f/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.452365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=a64a8f621ee244ceb531caa37d6cff8f, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.453837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.469571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 398/819] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:16:47 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/a64a8f621ee244ceb531caa37d6cff8f/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:16:47.470296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.497592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.583514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de026f-f6cb-4d79-9bae-dd7cccc6a7a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.588341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fdfb5-4fc0-426e-b886-d1163e3beaf6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.622290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.638420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.639045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.639326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.639591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.640437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:47.640849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.641316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.641940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.642223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.642326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.642551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.648185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 399/820] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:47.649221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.727237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.728762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.766415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541a31-9668-4d78-a94c-2b193f2fb630 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.801731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.802399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.802707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.802948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] PATH_INFO: `/v3/services/network` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.803216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.803661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.805109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:47.814788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:47.815886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:47.817359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 400/821] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:47.818215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.859357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 422/822] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:16:47.864893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:47.871272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:47.939586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff739-5fd8-4d7e-ab27-c1e3398cb37b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.980198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9066f2-ccce-4d03-996e-77d0593b143e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:47.986461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:47.987073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:47.987349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:47.987619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:47.988890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:47.989201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:47.990560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:47.998460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 401/823] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:47.999488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.022911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.023522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.023803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.024135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.024968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:48.025494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.027397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.037011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 423/824] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:48.037925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.063750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:48.115049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144cdb-9b3f-4d7b-b663-c7b4880bba16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.130659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:48.142760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc77ab1-dc62-475f-ac44-e819d735ea6b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.154723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.155594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.156089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.156619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.168453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.170228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.179363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.179984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.180265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.180536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.181259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.182618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:48.191275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:48.192177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:48.193139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:48.193139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:48.193139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:48.195443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 402/825] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:48.196503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.216733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 424/826] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:16:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:48.217779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.317427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a1976-69f9-450b-b10b-d29e2d683c90 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.362510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:48.364660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.365601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.366095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.366527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.369101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] RBAC: Adding query filter params (type=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:48.369682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.371368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.378544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 403/827] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:16:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:48.393465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.398934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152739b9-535d-4ea8-964a-d006a474de8f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.436790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.437422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.437711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.437990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.439119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:48.439119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.440406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.454536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 425/828] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:48.454850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:48.460932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.562186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37f0d2-3b27-49f7-8e48-a16422f64449 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.570199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846c909-707b-449c-ae64-68e560c0b7d8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.603270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.603877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.604156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.604428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.605211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.606360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.606573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.606994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.607274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.607549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.614543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.616012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.618694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:48.629565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:48.630636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:48.632086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 426/829] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:48.633059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 404/830] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:16:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:16:48.641486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.776554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695b30-f749-4bf2-b9e5-79b769698474 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:48.836662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:48.837336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:48.837624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:48.837899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:48.838597 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:48.838904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:48.840329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb228f0-5814-4e14-84f4-49e5c65a695a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:48.856152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 427/831] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:48.861891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:48.983593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:49.007299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d76389-8271-412f-b41b-eef4177846a5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:49.042499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:49.043030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.043305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.043571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.044347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:49.044689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:49.046166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec8e9-b05d-4183-8776-71b7cd5ae778 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:49.054511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 405/832] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:48 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:49.285055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aea2-c733-4bac-b198-e8b014355e65 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.286232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aea2-c733-4bac-b198-e8b014355e65 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.286713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aea2-c733-4bac-b198-e8b014355e65 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.289216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 428/833] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:49.294798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.295024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.295298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.314399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:49.315582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:49.387342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 406/834] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:49.659547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501aea2-c733-4bac-b198-e8b014355e65 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:49.721660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:49.769995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501aea2-c733-4bac-b198-e8b014355e65 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:49.806500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:49.807127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.807405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.807676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.818322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8ed548d4-2bc0-4c73-b003-5bec10ef4417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:49.823582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:49.824513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:49.825444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 429/835] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:49.830465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:49.880960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d91b9-3997-4623-86b8-eb91e0d09bf9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.881748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d91b9-3997-4623-86b8-eb91e0d09bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.882009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d91b9-3997-4623-86b8-eb91e0d09bf9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.884649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 430/836] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:49.889343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.890112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.890601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.911364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:49.913358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:49.932981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:49.941841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7238f8-7619-482c-ab8f-5c06a9a291fe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:49.986401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:49.987146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:49.987498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:49.987862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:49.988778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:49.989154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:49.990559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 431/837] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:16:49.992800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.002433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 407/838] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:50.008595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.060454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.115683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a42a4e-af39-43a5-a8d3-8b9132cfb5ef None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.150439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.151064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.151342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.151611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.161633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.163087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:50.179270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:50.180223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:50.181162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:50.181162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:50.181162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:50.181162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 432/839] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:50.188619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.291354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4ad3-303d-4204-aa2e-03b54b1939cb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.299165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.327875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.328593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.328958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.329317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.330020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:50.330329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.331766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.339805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.346347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 408/840] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:50.351928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.413358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.419774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332a719-1d4d-42fe-af66-4e73774a49cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.460466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c898263-e38e-43db-9848-56bb54f9b6bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.466804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.467449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.467732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.468555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.483261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:50.491734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:50.492697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:16:50.493635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:50.496648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 433/841] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:50.499830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.501847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.502648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.503031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.503367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.511769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.513534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:50.527069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:50.530593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:50.532538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 409/842] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:50.536824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.599104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.636068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0125-9ee7-4696-a0a4-d43813274556 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.645184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb71-2c0f-4efe-959e-624eed87d268 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.681080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.681737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.682080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.682869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.683765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:50.684145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.684647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.685499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.685847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.686173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.686625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.687494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:50.688357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.691033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.709189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 434/843] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:50.711126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.716751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 410/844] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:50.717842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.739944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.827927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0168-bc7d-479d-92d5-9627d0de0b93 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.836271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45c7f7-1ad1-4020-8b1a-4d40d20fd21d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:50.844831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:50.863664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.864295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.864553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.864853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.874998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:50.875731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.876015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.876295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.887739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.889399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4b843171-fd0a-4f9e-84e3-ab6b4d9e897d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:50.904918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:50.905926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:50.906834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:50.906834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:50.906834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:50.906834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 435/845] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:50.907539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d9ac-7be4-41ca-9d64-a00d20ffbfd6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:50.907635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d9ac-7be4-41ca-9d64-a00d20ffbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:50.907844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0d9ac-7be4-41ca-9d64-a00d20ffbfd6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:50.909861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 436/846] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:50.911472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0d9ac-7be4-41ca-9d64-a00d20ffbfd6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:50.944545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:50.947081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2ccb4-6d08-4101-a20d-554480f78aff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:50.987000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.019815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0d9ac-7be4-41ca-9d64-a00d20ffbfd6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.058509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.059115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.059389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.059657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.060297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:51.060617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.061970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.078431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 411/847] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 06:16:51.078431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.078431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.078431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.081307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 437/848] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:51.082110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.096896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:51.098381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:51.110766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.169570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 412/849] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:51.170520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.211457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bc-3fef-47fb-acca-3a6f40741853 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.248719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.257982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.258614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.258896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.259164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.272836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.274069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:51.291039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:51.292100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:51.293044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:51.293044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:51.293044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:51.297100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 438/850] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:51.298531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.329855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90851-2bd2-4c32-8bc5-624283abc05b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.373695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.374569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.374953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.375255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.383589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.385854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2af67748-d240-415e-b988-42d71109f7d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:51.400109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:51.401246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:51.402215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 413/851] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:51.403428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d70fb-43f8-4b71-afbf-dde06e9ac583 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.403428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d70fb-43f8-4b71-afbf-dde06e9ac583 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.403596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d70fb-43f8-4b71-afbf-dde06e9ac583 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.404848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 414/852] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:51.406805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d70fb-43f8-4b71-afbf-dde06e9ac583 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.416601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.427156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7702-0ebd-4c0f-a6ad-618527e7f5dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.466224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.466753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.467033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.467315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.467949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:51.468257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.469901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d576f5-ff12-44c1-ba12-e921c846f862 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.482330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 439/853] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:51.483538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.483827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.484111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.501866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:51.503052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:51.510805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d70fb-43f8-4b71-afbf-dde06e9ac583 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.543664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.544287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.544863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.545119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.545405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.546128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:51.546434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.547838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.565297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 415/854] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:51.566081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.571771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 440/855] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:51.572753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.628118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.669289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eda78-601d-484a-a762-7e014194122d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.675535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fe88-41b8-463f-80c5-3fe8ac08afa5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.702429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.703052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.703328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.703592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.704163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.705545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.712485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.713156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.713441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.713747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:51.714568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:51.715528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:51.716426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 416/856] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:51.717308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.726332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.727755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:51.738834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:51.739713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 441/857] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:51.745543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.780782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.825704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406e67-f6e9-49f2-9c8a-6367e2c1b8d6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.851249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a8a2-4656-4b01-b1a1-0898e963834b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:51.852579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.860899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.861508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.861790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.862068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.884848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:51.885454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:51.885734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:51.886014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:51.886638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:51.886948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.888302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.892705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 442/858] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:51.893467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:51.932911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:51.934343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:51.990305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:51.994951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9bc77-9901-4b16-8c7e-5236cc782aee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.028269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.028901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.029186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.029466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.029687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 417/859] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:16:52.030156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.030475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.030581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.031872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.044903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 443/860] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:52.045728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.057299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.127809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558682-22ab-4496-b223-d64f587fe549 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.148538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2bc3-9f68-431d-b002-0af7d8f9ac63 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.161599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.162230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.163016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.163288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.163872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.165256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:52.173967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:52.175183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:52.176124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 418/861] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:52.177023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.186070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.186655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.186937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.187212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.187844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.188149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.189623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.194006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 444/862] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:52.194769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.223140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.284794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.296168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b16b2-df54-46a7-b0d6-94ff0b7b9b7e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.313036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324905b-7dbb-47fe-a665-e81be8dc5b6f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.333078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.333604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.333887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.334199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.347003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.348474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.352235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.352903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.353184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.353454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.354181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=10878995ca2b405e975f1929d737a2ba) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.354488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.355963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.366887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 445/863] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/role_assignments?user.id=10878995ca2b405e975f1929d737a2ba&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:52.366887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:52.367175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:52.368252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:52.369422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:52.369422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:52.369422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:52.369422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 419/864] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:52.371918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.490206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.499336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2bc1-b06b-4f7b-a89a-46b18642bce6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.510658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d229d-a295-45c9-bf4b-585d930dc142 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.549174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.549716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.549912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.550351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.550351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.550508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.550771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.550881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.551045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.551138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.551695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.552005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.552455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.553970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.560050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 446/865] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:52.565566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.567952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 420/866] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:52.574171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.578012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.690278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0962c-c713-4cb0-9f0c-6dcf12d3c953 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.704873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c15a-5064-47da-84fe-516c4005f0a4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.731871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.733179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.733692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.734258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.735206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.735708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.737590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.743892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 447/867] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:52.745845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.746492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.746776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.747080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.759041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.760541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:52.774318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:52.775335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:52.776866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 421/868] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:52.785783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:52.804707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:52.902629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83bde-5543-48a8-abe9-40c6b657487e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:52.941903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:52.942870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:52.943154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:52.943427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:52.944718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:52.945030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:52.946455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df668e-daa1-46df-80a5-228946f40cb6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:52.960435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 448/869] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:52.966085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:53.035737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:53.076849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266206d2-3eda-409e-adb8-e83faf3522ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:53.112339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:53.112996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:53.113282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:53.113558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:53.114287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=a64a8f621ee244ceb531caa37d6cff8f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:53.114602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:53.116106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b0d6-ab26-4bca-a218-141b0546dfa4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:53.122684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 422/870] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:52 2022] GET /identity/v3/role_assignments?user.id=a64a8f621ee244ceb531caa37d6cff8f&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:54.448934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914892c-cfde-4f01-bd80-dafd411488fb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.449450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914892c-cfde-4f01-bd80-dafd411488fb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.449450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914892c-cfde-4f01-bd80-dafd411488fb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.451010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 449/871] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:54.456321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8464-dbba-4791-aa1f-b8807905eb1a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.456763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8464-dbba-4791-aa1f-b8807905eb1a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.456951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8464-dbba-4791-aa1f-b8807905eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.477409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-54ae8464-dbba-4791-aa1f-b8807905eb1a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:54.478604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-54ae8464-dbba-4791-aa1f-b8807905eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:54.552130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 423/872] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:54.664587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ae7e-5697-47b6-b48a-9697ee70badb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.664910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ae7e-5697-47b6-b48a-9697ee70badb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.665135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ae7e-5697-47b6-b48a-9697ee70badb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.666585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 450/873] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:54.672018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2d84-068e-48eb-9c72-37e6df2eefa4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.672524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2d84-068e-48eb-9c72-37e6df2eefa4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.673047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2d84-068e-48eb-9c72-37e6df2eefa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.692068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-732b2d84-068e-48eb-9c72-37e6df2eefa4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:54.693665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-732b2d84-068e-48eb-9c72-37e6df2eefa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:54.747874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:54.763565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 424/874] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:54.829708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ae7e-5697-47b6-b48a-9697ee70badb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:54.911818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:54.940548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ae7e-5697-47b6-b48a-9697ee70badb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:54.942237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf601c-f452-46f1-9041-d86079476b68 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.942530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf601c-f452-46f1-9041-d86079476b68 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.942808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf601c-f452-46f1-9041-d86079476b68 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.945669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 425/875] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:54.949712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.949998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.950273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.969125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:54.970312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:54.979972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:54.980603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:54.980895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:54.981173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:54.981830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:54.983294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:55.008721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 451/876] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:16:54 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:16:55.064000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 426/877] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:54 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:16:55.078182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:55.199052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b264dc-ee53-4820-97a2-abfca4efa14d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:55.236043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:55.236995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.237475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.237921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.238672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:55.240228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:55.242240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:55.251038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:55.252067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:16:55.252971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:55.254975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 452/878] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:16:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:55.261571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:55.362459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:55.376203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da67b6-b1bc-41f5-9e6f-9f8f01099744 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:55.396709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:55.432597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:55.433377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.433849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.434130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.434774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:55.435081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:55.437404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d21ed-5e91-430b-b567-707784d873b6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:55.442330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 427/879] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:16:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:55.443391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42947-056a-4796-afad-99e13383aaa2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.444272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42947-056a-4796-afad-99e13383aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.444545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42947-056a-4796-afad-99e13383aaa2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.445994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 428/880] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:55.448040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42947-056a-4796-afad-99e13383aaa2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:55.478415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7921c-1db0-4f7e-8c7d-10f1478e1c21 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:55.516472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:55.517331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.517615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.517894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.518555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:55.519909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07ea7-efaf-477f-a843-9830a73e3c35 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:55.540727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 453/881] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:16:55 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:16:55.542115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.542405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.542679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.566124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:55.567661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:55.575902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42947-056a-4796-afad-99e13383aaa2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:55.618756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:55.619388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:55.619667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:55.619938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:55.620684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:55.620990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:55.622600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:55.633174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 429/882] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:16:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:55.644514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:55.664074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 454/883] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:55.940898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:55.986656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:56.051632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525588bd-f936-44d3-b4a7-bcf232e3078c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.088237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.088904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.089190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.089466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.100820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:16:56.105622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:56.106547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:56.107376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 430/884] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:16:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:56.113037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.215677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e7c3d-b1d3-4143-a433-5d97f41203a1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.251085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.251701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.251985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.252258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.252952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:56.253259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:56.254606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:56.263313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 455/885] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:56.269082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.379325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:56.383590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0bd5-d7d3-45a2-ad66-652351d63100 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.420106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.420774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.421060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.421334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.432389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:56.433873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:56.448946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:56.449953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:56.451031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:56.451031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:56.451031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:56.451031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 431/886] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:56.455797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.514341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:56.569014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4ca35-4dc8-4d19-b272-4a29ffec44ef None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.604153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.604788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.605073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.605349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.605990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:56.606361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:56.607724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:56.619894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 456/887] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:56.625519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.731696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263bed-0305-4e3d-980d-4285ad1df274 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.768219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.768813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.769107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.769383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.778224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:56.779809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:16:56.792123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:56.793132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:56.794070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 432/888] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:56.799520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.907199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0901-57f6-4e7f-aabe-52e6e52af287 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:56.918593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:56.943428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:56.944040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:56.944321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:56.944617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:56.945347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:56.945651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:56.947065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261f95-b2be-4001-a00f-507dad82abd4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:56.965604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 457/889] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:56.971255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:56.987429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.084912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5067c-16f1-4be9-bc72-40b5e5fe9664 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.120169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.121189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.121696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.122191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.201381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.202891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:57.215003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.273572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563a20-204e-449b-ae09-b516dd62b06d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.273938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563a20-204e-449b-ae09-b516dd62b06d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.274160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563a20-204e-449b-ae09-b516dd62b06d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.276520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 458/890] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:16:57.281712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.281997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.282275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.300371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:57.301611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:57.311421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 433/891] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:16:56 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:16:57.321570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.381263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 459/892] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:16:57.429847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c0c3-5e5e-47eb-9e4c-81e1d3c0a2a3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.446037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.472029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.472695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.472977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.473250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.484256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.485910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:16:57.501920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:57.502939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:16:57.503865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:16:57.503865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:16:57.503865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:57.503865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 434/893] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:16:57.510331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.612763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.616662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59438b6f-2b4a-4849-bba9-fdeca80cf3bd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.653714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.654249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.654528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.654803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.655438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:57.655743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.657214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:57.662163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.670614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 460/894] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:57.675993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.779243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96d45-9ff5-44b4-bd3d-13ca5832c75c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.805993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d0b04-2605-4df5-b6ba-b7920692bd48 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.824400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.825055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.825336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.825609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.826211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.827624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:57.839283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:57.840464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:16:57.841738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:16:57.846523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 435/895] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:57.847499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.855183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.856167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.856683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.857225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.865703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.868029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:57.878136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-05ca4ed7-6c33-4700-a1b1-1acf62d684cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:16:57.884191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:57.885156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:16:57.886084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:57.892267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 461/896] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:57.892267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efbe0-cebb-4883-ba48-2bbf76cd54f9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.892267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efbe0-cebb-4883-ba48-2bbf76cd54f9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.892267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efbe0-cebb-4883-ba48-2bbf76cd54f9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.895036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 462/897] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:57.895814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efbe0-cebb-4883-ba48-2bbf76cd54f9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:57.917847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:57.958062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaa61b-f77e-4633-9902-c68ab4d981e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:57.992163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:57.992791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:57.993075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:57.993347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:57.993967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:57.994270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:57.995619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b5d8-c4dc-4df4-b05e-f640cf1f2189 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.001263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 436/898] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:58.001407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efbe0-cebb-4883-ba48-2bbf76cd54f9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.002411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.002700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.002973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.020162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:58.021900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:58.035579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.036535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.036873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.037214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.037915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:58.038229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.040033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af157-1a00-49c7-80bc-097823ecc287 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.054762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 463/899] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:58.056169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5734099-9319-44eb-b99d-6728495548b3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.056462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5734099-9319-44eb-b99d-6728495548b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.056765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5734099-9319-44eb-b99d-6728495548b3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.060691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 464/900] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:16:58.061461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5734099-9319-44eb-b99d-6728495548b3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.096899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 437/901] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:58.097654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.119409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.147760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.174734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5734099-9319-44eb-b99d-6728495548b3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.205920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86f09f-0bc1-4324-97aa-dc031829e1a2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.217031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.217943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.218494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.219034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.219656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:58.219957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.221334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500982a8-5348-4790-8e14-efa86e328bb4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.228709 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 465/902] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:58.229908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.230196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.230475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.246284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.246914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.247181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.247458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.248179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] RBAC: Adding query filter params (role.id=19ab924d585b48dc90a2759098346014, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=a64a8f621ee244ceb531caa37d6cff8f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:58.248279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:16:58.248494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.249430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:16:58.249955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.264999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 438/903] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/role_assignments?user.id=a64a8f621ee244ceb531caa37d6cff8f&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=19ab924d585b48dc90a2759098346014 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:58.264999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.342577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 466/904] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:16:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:16:58.368200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.388805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.408920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3920-59ab-41fe-b8b3-cf95adb8f9d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.465177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.465714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.465995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.466264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.466965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] RBAC: Adding query filter params (interface=public, service_id=3f5b08a0bdf44c7b97d768055e5aa75a, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:58.467274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.468653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.471786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.479681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 439/905] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/endpoints?service_id=3f5b08a0bdf44c7b97d768055e5aa75a&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:58.481217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.502978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cf37f-1518-4531-b041-fa489bf6e9e8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.539516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.540134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.540416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.540727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.541621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.542849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.568970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 467/906] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:16:58 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:16:58.605158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721a20-8afe-4c48-8397-3f3ebf9bef48 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.624740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.659051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.659793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.660081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.660358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.661013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.662996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.676594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 440/907] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:16:58.759558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d137-08b8-4f5d-9942-8c0da4282788 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.795096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.801767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.803423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.803423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.803423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.803700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.805076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:16:58.816451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:16:58.817667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:16:58.819131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:16:58.824745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 468/908] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:16:58.828600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:58.841741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:58.942244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c966-79ac-4b45-b6ea-4c91df43b701 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:58.977229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:58.977842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:58.978119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:58.978389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:58.979013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:58.979313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:58.980772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:58.985953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 441/909] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:16:58.992112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:59.108214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a3a9-1a16-4fc1-9797-c0395970e62f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:59.143607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:59.144710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:59.145196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:59.145667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:59.147053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:59.147573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:59.149173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:59.159099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 469/910] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:16:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:59.160420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:59.251830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:59.283272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5cfeb-d05a-4378-a449-323a378162b5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:59.317586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:59.318231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:59.318518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:59.318798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:59.319499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] RBAC: Adding query filter params (interface=public, service_id=cf5548c1ecc94873ae957eb7d84608f8, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:16:59.319815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:59.321312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b834d-b0bd-4416-af87-115ac271bb38 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:59.330734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 442/911] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:16:59 2022] GET /identity/v3/endpoints?service_id=cf5548c1ecc94873ae957eb7d84608f8&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:16:59.336723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:16:59.406087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:16:59.457363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253c3d-5ba4-401a-9bfa-333596066573 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:16:59.493869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:16:59.494836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:16:59.495321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:16:59.495793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:16:59.496661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:16:59.498218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46f595-9a5f-40fc-898f-30d53b49a2b5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:16:59.508698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 470/912] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:16:59 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:17:00.553391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d5e5-69b5-4d0e-80ab-950b1d00dd44 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.553955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d5e5-69b5-4d0e-80ab-950b1d00dd44 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.553955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d5e5-69b5-4d0e-80ab-950b1d00dd44 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:00.555542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 443/913] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:00.560820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b27bc-42bc-4d07-87de-6ed48826b73f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.561234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b27bc-42bc-4d07-87de-6ed48826b73f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.561409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b27bc-42bc-4d07-87de-6ed48826b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:00.580447 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2e9b27bc-42bc-4d07-87de-6ed48826b73f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:00.581683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e9b27bc-42bc-4d07-87de-6ed48826b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:00.652544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 471/914] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:00.841391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fbf7-337b-4736-80cb-dc2dfd8feedc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.841564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fbf7-337b-4736-80cb-dc2dfd8feedc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.841865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fbf7-337b-4736-80cb-dc2dfd8feedc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:00.843566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 444/915] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:00.849871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295f3d-413f-472a-abef-01b44e78005e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.850194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295f3d-413f-472a-abef-01b44e78005e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.850443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec295f3d-413f-472a-abef-01b44e78005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:00.870528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ec295f3d-413f-472a-abef-01b44e78005e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:00.871757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ec295f3d-413f-472a-abef-01b44e78005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:00.927194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:00.931858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7fbf7-337b-4736-80cb-dc2dfd8feedc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:00.958087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 472/916] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:00.990906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0312-1102-4d18-8bde-110444806869 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.991235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0312-1102-4d18-8bde-110444806869 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.991467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0312-1102-4d18-8bde-110444806869 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:00.992922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 473/917] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:00.998056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:00.998446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:00.998734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.018229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:01.019620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:01.047457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7fbf7-337b-4736-80cb-dc2dfd8feedc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.088953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.090565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.090692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.090974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.096453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.108699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:01.110057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 474/918] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:01.114248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:01.115306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:01.116146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.118696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 445/919] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:17:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:01.124847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.223562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb777d-a4e4-4ceb-b739-915edf072c4a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.251280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.253301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.276137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.277149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.277653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.278133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.278983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:01.279480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.281065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.295738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 475/920] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:01.298537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.374038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233066-f4f4-4900-b532-50b00df518ec None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.412012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.412679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.412958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.413230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.413811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.415168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:01.423804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:01.424831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.429613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 446/921] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:01.430396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.430465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251768-7c9c-417e-98c7-3987edd9ebb0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.467181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.467814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.468091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.468363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.484859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.486306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.497956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:01.500706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:01.501848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:01.502901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:01.502901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:01.502901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:01.506572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 476/922] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:01.507402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.536906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.542527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d24823-25c1-4440-aa46-a1aee4c935c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.578270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.578926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.579269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.579512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.580022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.581417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:01.590733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:01.591742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:01.592621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 447/923] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:01.593431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.618579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17741-d1a3-4268-8f24-9017532b5edc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.657189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.658118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.658546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.659057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.659861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:01.660341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.661972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.667630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 477/924] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:01.668768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.706138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374204af-ba85-4aaf-b9d8-44228ebe6a07 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.730239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.742426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.743033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.743325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.743581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.744215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:01.744515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.745902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.757568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 448/925] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:01.758429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.774146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.783147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f312b-6e2f-4983-b40c-69548b15b5e7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.816539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.817171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.817454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.817728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.818894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:01.819195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.820538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688a26-9be1-44a9-bbd3-2d46995d243f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.825456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 478/926] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:01.826570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f7fe-3098-4ecc-bdea-19c6b96db6bf None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.826857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f7fe-3098-4ecc-bdea-19c6b96db6bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.827142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f7fe-3098-4ecc-bdea-19c6b96db6bf None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.828356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 479/927] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:01.829072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f7fe-3098-4ecc-bdea-19c6b96db6bf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.857906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a798ea-09ef-4a6c-8324-b9205e7e2b27 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.891128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.891759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.892038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.892310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.892967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:01.893271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.894619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.899311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 449/928] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:01.900119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:01.932055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f7fe-3098-4ecc-bdea-19c6b96db6bf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:01.949470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:01.964315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:01.964963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.965242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.965510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:01.972990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:01.974918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a55fbeb2-453c-434b-9fe7-4b62ed72ae69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:01.986202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:01.987222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:01.988174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 480/929] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:01.988834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:01.988834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:01.988957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.001232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9a20-10c7-4499-8cee-c8304d731da8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.006476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:02.007643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:02.018217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.035913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.036520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.036883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.037118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.037739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:02.038046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.039391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.044395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 450/930] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Sep 9 06:17:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:02.045241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.075423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 481/931] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:02.076252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.144173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7bf3-7e47-449c-af9d-3ccb405c9e8a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.157181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.186192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.186817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.187102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.187375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.188073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] RBAC: Adding query filter params (interface=public, service_id=4c849aa2838843d8a8d138b56bf236e0, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:02.188387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.189792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.195029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 451/932] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/endpoints?service_id=4c849aa2838843d8a8d138b56bf236e0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:02.195782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.216091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee53c67-d9fb-4a01-be60-6af0438b3cbc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.256712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.257320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.257609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.257881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.258608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:02.258918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.260388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.285545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 482/933] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:02.285545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.290388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.301326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7192e-e182-40a4-beeb-b973886504c5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.336900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.337507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.337789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.338060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.338722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.340069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.359613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 452/934] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:02.360500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.398058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.412179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815651-0b7b-4d45-84dd-7fc58bca17e2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.458860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.459789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.460280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.460805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.461913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.464272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.484768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 483/935] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:17:02.484768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.494830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b13f-bc94-4243-a2d6-71fed0d1c4ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.547487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.548649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.548955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.549803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.564150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.565776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.571897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:02.584496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:02.585933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:02.586901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:02.586901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:02.586901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:02.586901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 453/936] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:02.591522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.624526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2666630-b45b-48f3-a4ae-07bd002d16c0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.666864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.667782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.668061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.668802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.669698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.671185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:02.682240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:02.683240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:02.684150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 484/937] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:02.691904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.704925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.715280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be4a9-4a40-4d50-8201-87df4d9034d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.754303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.755811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.756101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.756369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.757039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:02.757341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.759473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.776479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 454/938] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:02.787408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.815416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e794f-614d-42c9-a52a-0b305ca23bc0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.849970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:02.859050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.859673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.859956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.860321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.860938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:02.861304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.862686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:02.869780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 485/939] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:02.875049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:02.934946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddce5f-a32d-49ae-93dc-bccc6616c544 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.985785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:02.986436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:02.986718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:02.986993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:02.994950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5d68-c1b0-43d0-82f9-f2f778326f31 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:02.995915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:02.997473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:03.009853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:03.010820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:03.011729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 455/940] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:03.016497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:03.022348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:03.046210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:03.046981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:03.047362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:03.047735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:03.048471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:03.049427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:03.051171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:03.058578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 486/941] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:03.064396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:03.128793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:03.146992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889e29b-1220-4514-9069-6f2c2b0fdaa6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:03.179191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d616-03de-4f45-bfda-acf2a2fb5612 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:03.183437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:03.184181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:03.184470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:03.184822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:03.185528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:03.185843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:03.187282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:03.203431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 456/942] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:03.209397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:03.225619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:03.226481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:03.226964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:03.227379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:03.228210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:03.229873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd94a82-bd7b-43d3-a440-82c1ed564465 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:03.259895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 487/943] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:17:03.289685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:03.335727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649128e-18aa-4538-8b26-2b8a797ed3e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:03.383363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:03.384129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:03.384409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:03.384713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/a64a8f621ee244ceb531caa37d6cff8f/roles/19ab924d585b48dc90a2759098346014` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:03.387141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=a64a8f621ee244ceb531caa37d6cff8f, role_id=19ab924d585b48dc90a2759098346014)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:03.388647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed210-3614-420b-a0a1-6114a6adb168 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:03.407488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 457/944] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:17:03 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/a64a8f621ee244ceb531caa37d6cff8f/roles/19ab924d585b48dc90a2759098346014 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:17:04.858089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c438-3bd0-48dd-9eed-ffeabca30502 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:04.858611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654138d-df5f-4bd0-afa0-eb50894e2ff1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:04.858611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654138d-df5f-4bd0-afa0-eb50894e2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:04.859047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c438-3bd0-48dd-9eed-ffeabca30502 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:04.859124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654138d-df5f-4bd0-afa0-eb50894e2ff1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:04.859193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c438-3bd0-48dd-9eed-ffeabca30502 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:04.860191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 458/946] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:04.860296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 488/946] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:04.865229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:04.865362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:04.865531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:04.865628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:04.865784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:04.865973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:04.884948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:04.886133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:04.888600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:04.889753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:04.960814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 489/947] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:04.972777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 459/948] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:05.228927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.248194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.276477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.307628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.341290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace6bf-83b5-42af-8d0f-0f7c5786eecb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.364051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a305-0329-43dc-824f-ef1ca7e66f7a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.379116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.380181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.380799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.381275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.382055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.383805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:05.393422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:05.394453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:05.395317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:05.398306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 490/949] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:05.403682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.407312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.408004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.408349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.408714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.409432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.410927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.414490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING keystone.server.flask.common [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 06:17:05.433348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 06:17:05.433348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 06:17:05.433348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [parameters: {'id': '18779d96bd7f447889af7cce694ec4b7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 06:17:05.433348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18779d96bd7f447889af7cce694ec4b7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18779d96bd7f447889af7cce694ec4b7. Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:17:05.442338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 06:17:05.443605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Sep 09 06:17:05.444730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 06:17:05.445676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 06:17:05.446594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:17:05.447445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'id': '18779d96bd7f447889af7cce694ec4b7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.448323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:05.449160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18779d96bd7f447889af7cce694ec4b7. Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 460/950] 10.222.0.30 () {60 vars in 1140 bytes} [Fri Sep 9 06:17:05 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:05.450084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.540189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef947c3-03b5-4c0c-81c5-01af76e11db1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.548700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.563060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3224-a42c-4772-a4ea-0bcd5fc83574 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.572555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.583373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.584593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.585091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.586146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.587322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:05.587860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.589590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336130-1feb-4e36-b004-da1eec3202e0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.601357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 491/951] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:05.601357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b71b-c180-4392-8b89-da467a307ef2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.601639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b71b-c180-4392-8b89-da467a307ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.601847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b71b-c180-4392-8b89-da467a307ef2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.603258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 492/952] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:05.605128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25b71b-c180-4392-8b89-da467a307ef2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.607808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.608674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.609082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.609358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.617046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.618695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-92215e08-107f-431a-9a90-83e760fd579d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:05.631443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:05.632471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:05.633465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 461/953] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:05.634525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.634525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.634525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.654507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:05.656035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:05.721749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25b71b-c180-4392-8b89-da467a307ef2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.723842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 462/954] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:05.724796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.758147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.759143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.759490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.759764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.760384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:05.760727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.762077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e67b8-e5ca-40e0-bc5d-92d33d881df6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.771788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 493/955] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:05.771788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5d3c4-3739-42d2-b5a0-19769576c646 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.771788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5d3c4-3739-42d2-b5a0-19769576c646 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.771788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5d3c4-3739-42d2-b5a0-19769576c646 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.771788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 494/956] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:05.772696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5d3c4-3739-42d2-b5a0-19769576c646 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:05.809616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.825608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:05.832679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b09cb2-ab42-438d-8dcb-21bebfb933ac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.867381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.868016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.868260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.868530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.869221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:05.869525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.870937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abada3-e9ce-4389-8dcf-6f9a69b5708d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.882747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5d3c4-3739-42d2-b5a0-19769576c646 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:05.891022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 463/957] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:05.892233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.892523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.892815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.912753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:05.913989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:05.935333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:05.936807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:05.937303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:05.937754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:05.938625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:05.940904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:05.969175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 495/958] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:05.995144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.013925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 464/959] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:06.104443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:06.117645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea14-5c1e-4d7a-87f6-1ccad8e8ef15 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.157428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.158121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.158445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.158762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.159403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:06.160784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:06.170108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:06.171218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:06.172152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 496/960] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:06.178913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.275677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:06.294978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f14f-4295-4645-bcf0-65d5d9d0568e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.305846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.334785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.335400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.335681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.335956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.336634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:06.336918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:06.338293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:06.344597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 465/961] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:06.350095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.437100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bd290-ae32-4930-91ca-43decdedaba8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.481590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.482230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.482511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.482787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.484835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e18b-7759-48fc-9c7b-03b3ce85cfc3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.495497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:06.501389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:06.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:06.503214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:06.510077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 497/962] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:06.510077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.531089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:06.537656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.538278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.538558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.538832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.539464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] RBAC: Adding query filter params (type=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:06.539769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:06.541281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:06.548488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 466/963] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:06.635243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcce2f3-d3e7-48ec-b9f9-9f78374ea4ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.673528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.674150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.674433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.674709 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.675575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:06.675893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:06.677908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:06.687637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 498/964] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:06.693645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.711673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:06.803686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa83f-f62d-4413-8c21-17be6ca15aee None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:06.838840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:06.839481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:06.839761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:06.840035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:06.850519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:06.852016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:06.873251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:06.874702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:06.875609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:06.875609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:06.875609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:06.875609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 467/965] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:06.884690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:06.976955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:06.994847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4b4f5-12eb-4efe-af81-20bc36c93c83 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:07.030088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:07.030703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:07.030984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:07.031258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:07.031893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:07.032197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:07.033636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:07.046156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 499/966] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:07.051740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:07.116406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:07.157158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888427-7e5f-43a5-a089-8f428a001427 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:07.196018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:07.196978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:07.197463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:07.197960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:07.205919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:07.207598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:07.220018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:07.221029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 06:17:07.221983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:07.224536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 468/967] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:17:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:07.233888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:07.337200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f498-8020-41e3-a051-56c53f3c89d8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:07.373091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:07.373615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:07.373896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:07.374171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:07.374908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:07.375217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:07.376675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:07.380975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:07.400206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 500/968] 10.222.0.30 () {56 vars in 1149 bytes} [Fri Sep 9 06:17:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:07.401448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:07.508926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c3e7-385f-46de-a897-b2d2c51b0095 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:07.531787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:07.543777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:07.544384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:07.544692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:07.544968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:07.613258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:07.615261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:07.720032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 469/969] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:07.726286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:07.832316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539aa8-7474-43be-a6d3-0fd9eef9d1c7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:07.867931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:07.868590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:07.869025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:07.869301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:07.879803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:07.881828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:07.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:07.899958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:07.901720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:07.901720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:07.901720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:07.905312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:07.907314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 501/970] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:07.931278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.016291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9161-adc3-4912-873a-ea6c6ca5307a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.053831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.054500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.054831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.055112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.055752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:08.056057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.057521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.069476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 470/971] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:08.074782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.137466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.183666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578107e-fd5f-45ee-951e-a976c6f08079 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.218752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.219387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.219670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.219943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.226959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.228459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-048359f0-2337-4103-9f9a-febdeab10d46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:08.240484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:08.241416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.242693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 502/972] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:08.247632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.262093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998ed9-943a-4661-ade6-b253dcd1d981 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.262375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998ed9-943a-4661-ade6-b253dcd1d981 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.262651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998ed9-943a-4661-ade6-b253dcd1d981 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.264229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 503/973] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:08.269279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d525be-b37c-4efc-b6c7-4a6d17f1f3d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.269503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d525be-b37c-4efc-b6c7-4a6d17f1f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.269789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d525be-b37c-4efc-b6c7-4a6d17f1f3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.297500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a7d525be-b37c-4efc-b6c7-4a6d17f1f3d7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:08.298789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7d525be-b37c-4efc-b6c7-4a6d17f1f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:08.344045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.366219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0747e-6408-4aaf-9f96-e8b23399dd90 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.392591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 504/974] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:08.409333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d6add-4760-4ea1-9d20-7821923c3fe1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.409905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d6add-4760-4ea1-9d20-7821923c3fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.409905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d6add-4760-4ea1-9d20-7821923c3fe1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.415147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 505/975] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:08.415814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.416257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.416543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.416852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.417400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.417937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.418425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.419342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:08.419861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.421364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.434791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 471/976] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:08.443601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:08.443601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:08.443817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.488983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.514068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 506/977] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:08.561353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f28cf-b4e8-4a8b-be8d-7588afe7275a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.597336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.597939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.598216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.598485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.599203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] RBAC: Adding query filter params (role.id=19ab924d585b48dc90a2759098346014, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=a64a8f621ee244ceb531caa37d6cff8f) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:08.599510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.600952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.607077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 472/978] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:08 2022] GET /identity/v3/role_assignments?user.id=a64a8f621ee244ceb531caa37d6cff8f&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=19ab924d585b48dc90a2759098346014 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:08.677367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.784001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.795730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.801207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d44804-bcdf-4a79-a2b6-03dc55adec79 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.844694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.844694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.844694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.845039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.845387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.846818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.849937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING keystone.server.flask.common [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 06:17:08.863589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 06:17:08.863589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 06:17:08.863589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [parameters: {'user_id': 'c125e613f1aa48edad9a195f1c3c6fb3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 06:17:08.863589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-442b1dcb-2475-4e67-8b9d-549fcf1ccbbf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Sep 09 06:17:08.881945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:17:08.882900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 06:17:08.883905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 06:17:08.884874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 06:17:08.886482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 06:17:08.887350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c125e613f1aa48edad9a195f1c3c6fb3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:08.888238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 06:17:08.891272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 507/979] 10.222.0.30 () {60 vars in 1131 bytes} [Fri Sep 9 06:17:08 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea2b2-8158-477f-97d3-04037c287371 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea2b2-8158-477f-97d3-04037c287371 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.893750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ea2b2-8158-477f-97d3-04037c287371 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.895879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 508/980] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:08.895879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ea2b2-8158-477f-97d3-04037c287371 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:08.917649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6336d-2615-484a-b52e-44e0d93117e7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:08.930875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:08.960882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:08.961608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.961897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.962172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:08.962757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:08.964110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f452002e-16d1-4541-937d-90bf8dabe526 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:08.973425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:08.974577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:08.976294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 473/981] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:08.980624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:08.980917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:08.981199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.000365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:09.001590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:09.014941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ea2b2-8158-477f-97d3-04037c287371 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.052432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.052876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.053155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.053426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.061618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.063191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.069598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:09.074441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:09.080948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 06:17:09.081964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:09.082552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 474/982] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:09.082552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.082692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 509/983] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:09.082692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.197267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:09.207597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e57a-7f1c-442b-bfc4-3c8d981156f8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.211786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8379-a3b3-49c9-8d9c-edd72fab347a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.245703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.246150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.246367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.246596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.246762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.246855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.247029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.247305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.247488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:09.247854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.248018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:09.248294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.249312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.249742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.254430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 475/984] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:09.260162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.287661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 510/985] 10.222.0.30 () {56 vars in 1101 bytes} [Fri Sep 9 06:17:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:09.336646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:09.381375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eef2e-4ffb-411e-ab13-18415363f6cb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.393937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.425794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.426424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.426778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.427566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.428234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:09.428541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.429995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.435964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 476/986] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:09.441966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.528539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323dd1-25db-41a6-84a5-a73864683970 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.566949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.567594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.567873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.568142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.568827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.570318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.574365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2b14-5e00-454e-9ac0-d5e408cb57d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.593272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 511/987] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:17:09 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:09.610201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:09.628197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.629319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.629854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.630379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.631317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] RBAC: Adding query filter params (interface=admin, service_id=4c849aa2838843d8a8d138b56bf236e0, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:09.631833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.633572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8be05a-c700-455e-8bc4-b27731a76c19 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.640467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 477/988] 10.222.0.30 () {56 vars in 1249 bytes} [Fri Sep 9 06:17:09 2022] GET /identity/v3/endpoints?service_id=4c849aa2838843d8a8d138b56bf236e0&interface=admin®ion_id=RegionOne => generated 193 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:09.647389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:09.658032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:09.761018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900f7e4-7cbe-44f7-839a-6eb629f076c1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:09.798229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:09.798755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:09.799030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:09.799306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:09.799907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:09.801392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72968da-782f-415b-a51d-9dc7bbebab12 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:09.809293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 512/989] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:17:09 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:17:10.873838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56badbbd-b343-4211-9ae7-7e03c6973923 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:10.874365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56badbbd-b343-4211-9ae7-7e03c6973923 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:10.874365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56badbbd-b343-4211-9ae7-7e03c6973923 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:10.875769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 478/990] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:10.881469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:10.882004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:10.882089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:10.900373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:10.901955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:10.964378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:10.972609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 513/991] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:11.236087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56badbbd-b343-4211-9ae7-7e03c6973923 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:11.340810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56badbbd-b343-4211-9ae7-7e03c6973923 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:11.374968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:11.375608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.375945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.376223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] PATH_INFO: `/v3/services/image` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.376819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:11.378187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:11.387175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:11.388198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:11.393983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 479/992] 10.222.0.30 () {56 vars in 1105 bytes} [Fri Sep 9 06:17:11 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:11.396954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:11.498114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2774d-57eb-4c1a-90ab-1fce1c3d8abc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:11.531742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:11.532351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.532666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.532942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.533578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:11.533881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:11.535229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2fea8-766b-41a2-a8af-96ed026e5049 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:11.540281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 514/993] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:11.545639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:11.599496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:11.648667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11c967-9489-4fff-94b1-637ddb2b7494 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:11.683841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:11.684469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.684792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.685069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.685722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:11.686031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:11.687450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a964527-29fe-4c65-b716-e15c548a2193 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:11.700602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 480/994] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:11.797211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0d6a-9b4e-4e2d-be5b-e1b65a32d755 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.797409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0d6a-9b4e-4e2d-be5b-e1b65a32d755 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.797679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0d6a-9b4e-4e2d-be5b-e1b65a32d755 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.799060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 515/995] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:11.804686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38547-28a3-46e8-a0c7-a1e789e475ae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.804966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38547-28a3-46e8-a0c7-a1e789e475ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.805243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea38547-28a3-46e8-a0c7-a1e789e475ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.824960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fea38547-28a3-46e8-a0c7-a1e789e475ae None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:11.826222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fea38547-28a3-46e8-a0c7-a1e789e475ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:11.903408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 481/996] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:11.954756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5c88-3b19-4dfa-983e-468c32013d60 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.955301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5c88-3b19-4dfa-983e-468c32013d60 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.955301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5c88-3b19-4dfa-983e-468c32013d60 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.956778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 516/997] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:11.961960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:11.962253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:11.962536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:11.981067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:11.982252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:12.027597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.054335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 482/998] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:12.172047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5c88-3b19-4dfa-983e-468c32013d60 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.238530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.278827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5c88-3b19-4dfa-983e-468c32013d60 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.313323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.313880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.314218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.314497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.315075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.316429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.324317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:12.325723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:12.326685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:12.329319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 517/999] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:12.333492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.429578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda30b-d4d8-444a-b5a8-32369406a047 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.439355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43acd29-1b65-44ce-b574-6c88889a70db None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.466399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.468750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.469688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.470522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.471371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.472143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.473837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.474934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.475538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.475814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.476085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.476731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:12.477033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.478368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.482969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 518/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:12.484865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:12.485872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 06:17:12.486721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:12.489014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.491105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 483/1001] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:12.492054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.536032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.591830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b8a1-047b-476b-8abd-4af283251d29 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.602081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e289-f87d-4413-adab-8d59498932d6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.629105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.629811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.630097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.630366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.630998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:12.631306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.632739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.637916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 519/1002] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:12.641345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.641955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.642235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.642502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.643127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:12.643430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.643885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.644801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.654712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 484/1003] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:12.656058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.704069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.751090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4a37b-c0ea-47c3-86ef-968a61ce46d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.754242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289e1f-d4f6-4550-afe2-c1cebaac3dc2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.757121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.787659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.788263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.788551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.788943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.789552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] RBAC: Adding query filter params (interface=public, service_id=013dc2bd141e4ab6895cecb1f5cf5bad, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:12.789761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.789889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.790363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.790641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.790909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.791267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.791525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:12.791825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.793187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.803144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 485/1004] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:12.803310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 520/1005] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/endpoints?service_id=013dc2bd141e4ab6895cecb1f5cf5bad&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:12.805038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.805173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:12.905159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb3e7-8041-4f4b-8e6a-3db25bd4277d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.916559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025316-78e8-460c-b4a1-bbe824019207 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:12.941114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.941734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.942012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.942371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.943045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.944502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e9d6a-d9a6-435f-b497-b52b2125464b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.946349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:12.962821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:12.963557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:12.972848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:12.972848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:12.973130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 486/1006] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:12.973255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:12.973255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ace17-9ba8-43d5-a831-34d9f15cfe6d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:12.979465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 521/1007] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:17:12 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:17:13.907824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8493f-3080-4001-82c0-8bbf2966a500 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:13.908352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8493f-3080-4001-82c0-8bbf2966a500 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:13.908352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8493f-3080-4001-82c0-8bbf2966a500 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:13.909893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 487/1008] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:13.914968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dbd8-c1dc-422e-a512-9f3c59dd14af None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:13.915260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dbd8-c1dc-422e-a512-9f3c59dd14af None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:13.915539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059dbd8-c1dc-422e-a512-9f3c59dd14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:13.933891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b059dbd8-c1dc-422e-a512-9f3c59dd14af None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:13.935069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b059dbd8-c1dc-422e-a512-9f3c59dd14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:14.009059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 522/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:14.276080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8493f-3080-4001-82c0-8bbf2966a500 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:14.307440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:14.383223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8493f-3080-4001-82c0-8bbf2966a500 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:14.414968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:14.415573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:14.415847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:14.416115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:14.416796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:14.418145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df05d90-7636-4a86-89bc-2254dd795b78 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:14.433863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 488/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:17:14 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:15.177748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c95e0-399f-42b8-a011-432b753905c1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.177748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c95e0-399f-42b8-a011-432b753905c1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.177748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c95e0-399f-42b8-a011-432b753905c1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.181171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 523/1011] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:15.187809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c3cab-0d88-4a95-bd9d-bad953abe570 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.189719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c3cab-0d88-4a95-bd9d-bad953abe570 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.189907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.190233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c3cab-0d88-4a95-bd9d-bad953abe570 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.193300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.193300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.193464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 489/1012] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:15.198254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.198545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.198823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.216954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:15.217816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:15.218115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:15.219219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:15.293991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 490/1013] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:15.300757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 524/1014] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:15.565140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:15.574224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:15.583404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:15.614188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:15.682158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df74e-245c-4fae-90c5-98e60d1c885d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:15.685134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55709380-5fd1-4b93-a9c5-5a0abc9f4efa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:15.718004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:15.719013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.719290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.719560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.720137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:15.721514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:15.721909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:15.722538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.722817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.723220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.724366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:15.725678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:15.727395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 525/1015] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:15.730782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:15.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:15.733694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 491/1016] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:15.734523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:15.737580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:15.817526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:15.840986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd023e8-eaf1-49fd-ad77-09d1b120da99 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:15.844636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69394d-1ed7-480f-ac80-a759c86d03ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:15.847687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:15.881854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:15.882466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.882746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.883013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.883632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:15.883933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:15.885304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:15.885788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:15.886392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:15.886675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:15.886956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:15.887600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:15.889179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:15.895316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 492/1017] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:15.896427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:15.920733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 526/1018] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:17:15 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:16.013293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90675d2-4c10-400f-b788-fea5bb007c1b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:16.049336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:16.049969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:16.050246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:16.050514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:16.051155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:16.052020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:16.053431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808d65d-aa1d-4b57-b5d9-1e354ad2a665 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:16.063827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 493/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Fri Sep 9 06:17:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:16.065558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:16.171798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ffc2-d1a1-4cbf-a13b-4513ba62f7b7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:16.210285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:16.210960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:16.211166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:16.211433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:16.212113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:16.213619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b2105-7925-496b-acfb-bb1b96a7967d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:16.234197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 527/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:16.633145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b23-bc0f-4b01-957a-1f5cc644f38b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:16.633668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b23-bc0f-4b01-957a-1f5cc644f38b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:16.633668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b23-bc0f-4b01-957a-1f5cc644f38b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:16.635059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 494/1021] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:16.640476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:16.640913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:16.641258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:16.659883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:16.661650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:16.669374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:16.737312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 528/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:17.005713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1b23-bc0f-4b01-957a-1f5cc644f38b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:17.015584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:17.109430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1b23-bc0f-4b01-957a-1f5cc644f38b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:17.142853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:17.143482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:17.143757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:17.144024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] PATH_INFO: `/v3/services/image` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:17.144679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:17.146566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:17.155336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:17.156337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:17.157832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 495/1023] 10.222.0.30 () {56 vars in 1105 bytes} [Fri Sep 9 06:17:17 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:17.163713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:17.271657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377068-38f1-43eb-b0c4-846f6f540b13 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:17.304640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:17.305242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:17.305522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:17.305795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:17.306415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:17.306716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:17.308052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:17.312923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 529/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:17.318492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:17.389016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:17.422885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e2-d2ca-4795-a9b1-aa6b8d487e09 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:17.456210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:17.456846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:17.457126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:17.457929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:17.458555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:17.458859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:17.460283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:17.465231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 496/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:17.471474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:17.474984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:17.573559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50be71-40c2-4782-ba7d-40230bfde7b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:17.607942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:17.608557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:17.608874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:17.609148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:17.609844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] RBAC: Adding query filter params (interface=public, service_id=d07c74f36fa24891affefc7316f7ff0c, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:17.610156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:17.611504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01980fc-7097-40dc-8caa-459f40979ab8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:17.616892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 530/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:17:17 2022] GET /identity/v3/endpoints?service_id=d07c74f36fa24891affefc7316f7ff0c&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:17.622363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:17.725753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c30c3-7b3c-41cb-93d8-b6b9fe79aed5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:17.759659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:17.760278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:17.760573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:17.760862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:17.761468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:17.762827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a132b-8242-4681-95f2-881a3428a166 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:17.763900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:17.771417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 497/1027] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:17:17 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:17:18.139925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce197-de3e-4918-9666-a33a17565425 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.140275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce197-de3e-4918-9666-a33a17565425 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.140485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce197-de3e-4918-9666-a33a17565425 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.141869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 531/1028] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:18.147680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5196-ac2f-459c-82ee-a1cf2ec02c32 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.148076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5196-ac2f-459c-82ee-a1cf2ec02c32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.148455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5196-ac2f-459c-82ee-a1cf2ec02c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.167220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-082e5196-ac2f-459c-82ee-a1cf2ec02c32 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:18.168579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-082e5196-ac2f-459c-82ee-a1cf2ec02c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:18.240649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 498/1029] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:18.513783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ce197-de3e-4918-9666-a33a17565425 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:18.515900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8143-ba1d-4c62-80ce-8e28414bfd14 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.516193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8143-ba1d-4c62-80ce-8e28414bfd14 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.516471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8143-ba1d-4c62-80ce-8e28414bfd14 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.517865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 499/1030] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:18.523524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.523813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.524145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.542021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:18.543192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:18.596022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:18.630790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ce197-de3e-4918-9666-a33a17565425 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:18.632141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 500/1031] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:18.667261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:18.668008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.668361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.668750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.670005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:18.671510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:18.673349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 532/1032] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:18.679331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:18.739288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:18.782498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54d9c0-bd67-4873-9c8d-bea092d4b3af None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:18.816438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:18.817621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:18.817902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:18.818177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:18.818835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:18.820257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:18.844429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 501/1033] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:17:18 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:18.909561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.015819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925e431-658d-4e44-baf2-e472c489ad7b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.052405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.052996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.053284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.053546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.055574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:19.065055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:19.070379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:19.071338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:19.072197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 533/1034] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:17:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:19.077764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.192034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd652-bfd2-4740-b443-ac8d61abfd2c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.206128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:19.229723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.230346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.230659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.230980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.231669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:19.232206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:19.234103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:19.248130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 502/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:19.249469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.351003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07846-b87c-4bd3-a82e-8b0d58dbc546 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.384771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.385404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.385684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.385953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.396616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:19.398071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:19.412747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:19.413718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:19.414635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:19.414635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:19.414635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:19.416894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 534/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:19.419530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.522057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5fe90-864e-4a7d-8b9c-b6961ca60bb7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.556788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900319-1620-4522-a445-2ac655066efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.557409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900319-1620-4522-a445-2ac655066efc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.557742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900319-1620-4522-a445-2ac655066efc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.558024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900319-1620-4522-a445-2ac655066efc None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.558669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900319-1620-4522-a445-2ac655066efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:19.558977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900319-1620-4522-a445-2ac655066efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:19.560335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900319-1620-4522-a445-2ac655066efc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:19.576690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 503/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:19.578348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.627594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:19.683091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878c2f-f407-4b82-a72d-e744bbe12a5f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.716736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.717365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.717646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.717919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.725618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:19.727042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:19.737937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:19.739512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:19.740537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:19.741844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 535/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:19.745360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900319-1620-4522-a445-2ac655066efc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.785036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:19.858920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900319-1620-4522-a445-2ac655066efc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:19.893439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:19.893975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.894259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.894533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.895289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:19.895597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:19.897301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecba4a-c25f-430f-be85-8fb241b28a12 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:19.919235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 504/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:19.920439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:19.947665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac5d2-2250-4366-8bc9-228389bd4322 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.947963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac5d2-2250-4366-8bc9-228389bd4322 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.948237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac5d2-2250-4366-8bc9-228389bd4322 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.949705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 505/1040] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:19.954415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:19.954750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:19.955030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:19.973524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:19.974700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:20.025457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dcd20-9ecc-4a06-ab96-79636640f54b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.033967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.043971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 506/1041] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:20.064078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.064720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.065083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.065356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.134110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.135558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.248157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 536/1042] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:19 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 06:17:20.249998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.275439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.309216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.317711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.356427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054a105-6bde-4499-9307-b86931ea4cba None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.391501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.391905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.392180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.392446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.405695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.407411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.417530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5345c02-dd3c-4efd-a8c4-85e471ef1351 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:20.424072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:20.425042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:20.425961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:20.425961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:20.425961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:20.425961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 507/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:20.430909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.457706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.458250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.458580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.458858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.459446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.460995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:20.470260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:20.471280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:20.472158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 537/1044] 10.222.0.30 () {56 vars in 1105 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:20.477368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.513243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.542512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bc57-db05-47fb-9589-550004f944bf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.549569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.580757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.581364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.581643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.581916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.582574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:20.582879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.584225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.587997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507580b-d5d9-4d33-b116-f5e0dd56aaa4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.595836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 508/1045] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:20.602074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.625582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.626185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.626500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.626730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.627339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:20.627638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.629005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.634648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 538/1046] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:20.639890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.713561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017b18-1110-4047-b65a-d1b286ff153b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.743378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b1de5-200e-4f03-ac1c-241c7fb68e9a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.748766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.749407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.749688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.749961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.753289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.759268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.760836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:20.773237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:20.774143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:20.775121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 509/1047] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:20.779918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.783668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.784286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.784591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.784874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.786037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:20.786346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.787702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.790105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:20.798598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 539/1048] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:20.799845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.886030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dca8e-55de-436c-8a6c-abad4b600276 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.909876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816561-4567-467a-bc2a-9d7fc5806bd3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:20.924536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.925282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.925563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.925836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.926564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:20.926870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.928328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.944452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 510/1049] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:20.946947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:20.950364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:20.950975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:20.951251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:20.951529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:20.952196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:20.953571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845c036-d469-4b65-947a-4da51e0b902e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:20.978000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 540/1050] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:17:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:21.021278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:21.071600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc7c30-4116-4d5c-9c50-1f80367309c8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:21.094802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de73d-595a-4569-b057-4d1362f95142 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.095093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de73d-595a-4569-b057-4d1362f95142 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.095372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de73d-595a-4569-b057-4d1362f95142 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.096774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 541/1051] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:21.102552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.102826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.103106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.120595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:21.121240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.121525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.121797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.122529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] RBAC: Adding query filter params (role.id=19ab924d585b48dc90a2759098346014, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:21.122843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:21.123352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:21.124470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:21.124617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:21.140598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 511/1052] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:20 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=19ab924d585b48dc90a2759098346014 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:21.200983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:21.223493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 542/1053] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:21.491921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:21.595617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275d7b-6f92-46dd-9623-be21590a5b05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:21.612352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:21.631609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:21.632244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.632525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.632829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.644297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:21.649774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:21.650724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:21.651633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:21.655722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 512/1054] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:21.657034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:21.757358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89411e2-a5b5-4876-9128-6af105ab8325 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:21.791183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:21.791794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.792073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.792345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.793039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:21.793345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:21.794691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:21.808279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 543/1055] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:21.809729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:21.913577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9a1f4-546d-442f-ac03-6be6360ca06d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:21.949324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:21.949956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:21.950236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:21.950507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] PATH_INFO: `/v3/users/3b4986a5d2074db99913e0f3c1e4a996` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:21.966568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4986a5d2074db99913e0f3c1e4a996)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:21.968350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:21.976499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 513/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:21 2022] GET /identity/v3/users/3b4986a5d2074db99913e0f3c1e4a996 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:21.978147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:22.046854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:22.132864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95546eb-c767-4945-8d79-4d9d831451b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:22.189922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:22.190034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:22.190296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:22.190530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:22.262413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:22.263893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:22.310390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:22.373733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 544/1057] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:22.375574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:22.411921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:22.480351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501bd1-0bb3-4f88-a53f-22a8dc137759 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:22.515338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:22.515971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:22.516255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:22.516531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:22.517683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:22.519106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51818-6b35-4854-aa9f-09d7dc131031 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:22.521029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 514/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:22 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:22.526928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:22.625187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cb18b-d73d-4446-bf4a-d3c32cb1d65d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:22.659288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:22.659901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:22.660185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:22.661029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:22.661749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=db1c1812de0946eca8ae3349adcae4ec, user.id=3b4986a5d2074db99913e0f3c1e4a996) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:22.662059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:22.663473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c996-01bb-4ae7-a5dd-2f9b417c2236 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:22.669007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 545/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:22 2022] GET /identity/v3/role_assignments?user.id=3b4986a5d2074db99913e0f3c1e4a996&scope.project.id=db1c1812de0946eca8ae3349adcae4ec&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:23.214139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba50c9-6b6a-4351-9e88-05c486066cc9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.214676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba50c9-6b6a-4351-9e88-05c486066cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.214676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba50c9-6b6a-4351-9e88-05c486066cc9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.216066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 515/1060] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:23.222547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31b4-7c01-4936-b670-fb94f9210cab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.222914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31b4-7c01-4936-b670-fb94f9210cab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.223319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf31b4-7c01-4936-b670-fb94f9210cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.243215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-25bf31b4-7c01-4936-b670-fb94f9210cab None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:23.244440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-25bf31b4-7c01-4936-b670-fb94f9210cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:23.247782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:23.314876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 546/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:23.338792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c145e5-f319-44e3-938a-8d9133887020 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.339075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c145e5-f319-44e3-938a-8d9133887020 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.339342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c145e5-f319-44e3-938a-8d9133887020 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.340835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 516/1062] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:23.345986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.346277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.346553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.365018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:23.366189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:23.430067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 547/1063] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:23.584336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c145e5-f319-44e3-938a-8d9133887020 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:23.687957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c145e5-f319-44e3-938a-8d9133887020 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:23.689644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:23.692614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:23.728364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:23.729118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.729402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.729675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.763491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:23.796995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc95cb-f34f-4db1-a4f8-6c0e432ddd64 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:23.799211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:23.800953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:23.832642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:23.833364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:23.833718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:23.834063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:23.845432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:23.850696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:23.851634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:23.852495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 548/1064] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:17:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:23.857694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:23.904939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 517/1065] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:23.910447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:23.912385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:23.971518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eb5a8-7d1b-4bf6-be28-a8329b009fe4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.002628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:24.009738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.010399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.010622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.010898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.011563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:24.011873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.013754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.019250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f4c53-00b1-4820-8378-e9434f506d8f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.022676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 549/1066] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:17:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:24.028061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.058472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.059328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.059609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.059884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.070929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.072786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:24.087948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:24.089038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:24.089970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:24.089970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.089970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:24.094701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 518/1067] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:24.095244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.136228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11436432-a59f-43a6-8aab-f5680f326cc2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.154072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:24.173909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.174542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.174826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.175101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.193538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.195019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.204405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d22f1-f85e-45fc-9324-82219f4635d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:24.210490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:24.211445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:24.212522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:24.212522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.212522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:24.212522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 550/1068] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:24.217359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.241616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.242234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.242506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.242796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.243432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:24.243738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.245136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.257206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 519/1069] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:24.276382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:24.337997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfc77-2333-4982-87c4-10f53a70ab25 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.380028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.381122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.381604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.382010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.382731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:24.383057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.384518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.402591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 551/1070] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:24.404503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.510160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e774-2157-4d86-8695-9428bb00c3cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.525166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:24.548180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.548903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.549189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.549469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.558407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.559855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:24.571826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:24.572856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:24.573831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 520/1071] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:24.578950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.685756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d069ce-3a90-46a3-8c57-81801b1c89e2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.688797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:24.723009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.723664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.723884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.724152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.724909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:24.725216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.726614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73086203-7ab4-4705-a339-236ad791b0f3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.744145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 552/1072] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:24.749904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:24.805033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beeb7e-bf66-4582-aa5b-bd09af1b8cd0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.805317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beeb7e-bf66-4582-aa5b-bd09af1b8cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.805602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beeb7e-bf66-4582-aa5b-bd09af1b8cd0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.806909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 553/1073] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:24.811891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.812207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.812486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.830939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:24.832121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:24.849260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df75aee-67d6-4ab9-acd4-1eb6f05c4def None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:24.882962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:24.883583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:24.883860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:24.884133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:24.894496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:24.895929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:24.898352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 554/1074] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:24.909954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:24.911026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:24.911923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:24.911923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:24.911923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:24.911923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 521/1075] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:24.916888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.006185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.015479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4749b52-b057-413d-b147-7dd7a8c2f042 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.049088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.049685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.049964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.050234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.050871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:25.051173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.052519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.063368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 555/1076] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:25.069623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.097484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.167804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efecc8-e11e-4378-a179-df930d4db77d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.169095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.204425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.205071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.205349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.205616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.212639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.214069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:25.225235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:25.226344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:25.227436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 522/1077] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:25.232148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.272862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef766-2d5d-4d8e-8ac4-9e2ca35554bd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.312958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.313854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.314273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.314845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.319756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.331782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:25.336845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c058-31e7-4a27-9cc2-eddd98959ecb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:25.338218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:25.339355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:25.340317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 556/1078] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:25.345507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.361363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.373888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.374524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.374789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.375063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.375780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:25.376091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.377542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.389736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 523/1079] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:25.396138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.448255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a39-fd5e-4ba1-8252-98a07b9bcbfa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.480999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.481595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.481873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.482143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.482792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:25.483099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.484432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.492658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65532-cf88-40cc-bbfd-b78c4b28b72c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.493642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 557/1080] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:25.499328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.525950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.526539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.526824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.527098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/19ab924d585b48dc90a2759098346014` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.529222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=6d7cab58d5cc49469cf0ba0180f19100, role_id=19ab924d585b48dc90a2759098346014)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.530635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.543059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 524/1081] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:17:25 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/6d7cab58d5cc49469cf0ba0180f19100/roles/19ab924d585b48dc90a2759098346014 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:17:25.582232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.608969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6d092-f125-4b4a-8342-4e2be20b04d4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.645776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.646426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.646707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.646980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] PATH_INFO: `/v3/users/3b4986a5d2074db99913e0f3c1e4a996` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.648159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] RBAC: Authorizing `identity:get_user(user_id=3b4986a5d2074db99913e0f3c1e4a996)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.649642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.651251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 558/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/users/3b4986a5d2074db99913e0f3c1e4a996 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:25.657302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.666506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:25.763139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f726f-f391-47b7-87f5-41f9f262d1b7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.796012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.796610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.796883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.797157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.798267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.799692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72675d-af7c-4e1f-b877-939e2623b7f4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.801894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 525/1083] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:25 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:25.807677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:25.904488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc0dc-59d6-40e0-9cca-bd6bd3a9827d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:25.937744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:25.938391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:25.938672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:25.938944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec/users/3b4986a5d2074db99913e0f3c1e4a996/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:25.940835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c1812de0946eca8ae3349adcae4ec, user_id=3b4986a5d2074db99913e0f3c1e4a996, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:25.942281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6b254-023c-4f8c-b45e-ddfff568f119 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:25.954817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 559/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:17:25 2022] PUT /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec/users/3b4986a5d2074db99913e0f3c1e4a996/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:17:27.672747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e92b8-e89a-48c5-9bb2-6a437c8578d2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:27.673347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e92b8-e89a-48c5-9bb2-6a437c8578d2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:27.673347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e92b8-e89a-48c5-9bb2-6a437c8578d2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:27.674626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 526/1085] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:27.680387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861bdd-c389-4736-938d-c1083f2f212b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:27.680844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861bdd-c389-4736-938d-c1083f2f212b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:27.681120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c861bdd-c389-4736-938d-c1083f2f212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:27.687413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:27.700609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2c861bdd-c389-4736-938d-c1083f2f212b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:27.701787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c861bdd-c389-4736-938d-c1083f2f212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:27.765635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 560/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:28.031468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e92b8-e89a-48c5-9bb2-6a437c8578d2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.071754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283333-ce72-4655-94fb-aa6629ab9950 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.072049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283333-ce72-4655-94fb-aa6629ab9950 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.072352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283333-ce72-4655-94fb-aa6629ab9950 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.073717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 561/1087] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:17:28.078788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.079074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.079348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.097664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:28.098843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:28.109861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.135833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e92b8-e89a-48c5-9bb2-6a437c8578d2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.164324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 562/1088] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:17:28.169924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.170554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.170835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.171109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.181634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:28.186401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:28.187569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:28.188684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 527/1089] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:28.194132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.252536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.289150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b91cf-9d5a-442a-a681-ca27aa3e6d90 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.321895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.322486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.322761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.323028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.323674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:28.323972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.325339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.332949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 563/1090] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:28.338870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.433333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.441787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0b4c-b749-4843-9659-c8fd8595742e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.476683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.477306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.477583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.477865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.479801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.488957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.490447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:28.504993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:28.511018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:28.512005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:28.512005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:28.512005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:28.512005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 528/1091] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:28.512005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.532404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133635f-5ef0-4c96-8b13-ef0266755311 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.556966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.567736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.568469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.568780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.569055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.579319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:28.584575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:28.585688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:28.586553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 564/1092] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:28.591501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.611657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd4ff3-1a48-4b31-8cf0-10a471e2eb60 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.646905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.647702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.648115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.648414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.649667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:28.649925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.651660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.664084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 529/1093] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:28.669786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.690936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2600-2255-4ffe-9678-65e71430dcba None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.719336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.725973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.726578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.726862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.727138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.727792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:28.728097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.729477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.738039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 565/1094] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:28.743739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.770909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50224c0-2da6-4ffe-8bd4-8aaf87a621fa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.789241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.804955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.805580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.805860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.806130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.813051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.814420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:17:28.826206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:28.827316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:28.828294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 530/1095] 10.222.0.30 () {56 vars in 1093 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:28.833610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.845197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28962dc0-11eb-4c17-8bf3-3e8e18c4867e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.879618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.880244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.880521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.880822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] PATH_INFO: `/v3/users/3b4986a5d2074db99913e0f3c1e4a996` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.881935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4986a5d2074db99913e0f3c1e4a996)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.883539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.885145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 566/1096] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/users/3b4986a5d2074db99913e0f3c1e4a996 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:28.890852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.931951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5402-b84d-4aa6-b3d2-d76b13494980 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:28.939141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:28.968731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:28.969339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:28.969626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:28.969901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:28.970654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:28.970966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:28.972391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:28.990270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 531/1097] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:28.996115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:28.999244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4ffa-80e5-451e-b99a-07b4975ab1a5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.020679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.041942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.042551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.042829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.043102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.103808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d884b89-4945-4593-acfe-fa96862b2aed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.110726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.112173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.137815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.138414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.138690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.138961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.169158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.211148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.211307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 567/1098] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 06:17:29.212789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.216991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.231073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.311491 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 532/1099] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 06:17:29.313409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bebe-ff02-4866-8c69-0a55d8fc0d1b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.317885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.351223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.351934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.352221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.353243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.353711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.355224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.356891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 568/1100] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:29.362979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.382255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.420323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f497f8-b3e4-4518-8218-9fa26c7dd9cf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.441758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.454026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.454660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.454942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.455219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.460280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc8ce-94cf-49f3-8dd9-ef98cb8704c7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.465467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.466908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:17:29.482296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:29.483381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:17:29.484301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:17:29.484301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:17:29.484301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:29.484301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 533/1101] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:17:29.489087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.496059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.496697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.496982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.497257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.497987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=db1c1812de0946eca8ae3349adcae4ec, user.id=3b4986a5d2074db99913e0f3c1e4a996) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:29.498297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.499706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.517118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 569/1102] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/role_assignments?user.id=3b4986a5d2074db99913e0f3c1e4a996&scope.project.id=db1c1812de0946eca8ae3349adcae4ec&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:29.592067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac64c-d433-484a-b96d-0c7a100ea923 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.609805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:29.628441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.629783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.630066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.630344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.631001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:29.631308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.632730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.650725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 534/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:29.652026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.753476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80937f3-e833-4ea4-9a5b-6023aa9175da None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.786184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.786809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.787090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.787363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.793894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.795309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:17:29.806961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:29.807894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:29.809275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 570/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:29.813843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.912997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f624-6bd8-4b56-815b-f5bec2c2b3ab None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:29.945511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:29.946117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:29.946400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:29.946674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:29.947371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:29.947678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:29.949142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed51c-e73e-491c-b1bd-d656e1d6287a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:29.960926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 535/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:29.966961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:29.976991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:30.065825 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f8ed-d41d-4ff1-941d-a507e3a59fc5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:30.099625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:30.100231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:30.100515 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:30.100821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:30.101540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] RBAC: Adding query filter params (role.id=19ab924d585b48dc90a2759098346014, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=6d7cab58d5cc49469cf0ba0180f19100) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:30.101851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:30.103260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44e916-f9ff-4a11-b984-7f4047305d4f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:30.108933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 571/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:29 2022] GET /identity/v3/role_assignments?user.id=6d7cab58d5cc49469cf0ba0180f19100&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=19ab924d585b48dc90a2759098346014 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:31.700344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cce0c-4b6b-4129-9aad-9134a08e8bcf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:31.700929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cce0c-4b6b-4129-9aad-9134a08e8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:31.700929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cce0c-4b6b-4129-9aad-9134a08e8bcf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:31.702270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 536/1107] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:31.707661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:31.708090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:31.708217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:31.726159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:31.727334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:31.788303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:31.793171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 572/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:32.063510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cce0c-4b6b-4129-9aad-9134a08e8bcf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:32.100823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:32.165353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cce0c-4b6b-4129-9aad-9134a08e8bcf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:32.198508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:32.199135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:32.199415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:32.199688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:32.200817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:32.202243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933356e-5163-4059-8718-335ab3137f3f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:32.203798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 537/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:32.209448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:32.303618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97d55-9817-4082-8ad2-52a076b934c4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:32.335854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:32.336387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:32.336695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:32.336973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:32.337615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:32.339014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3133dc-5500-487f-932f-2fc6b5997d1d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:32.359074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 573/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:17:32 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:34.539093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b2ba-49e0-4cf1-87c7-f5a9b7d3edc2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:34.539610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b2ba-49e0-4cf1-87c7-f5a9b7d3edc2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:34.539702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b2ba-49e0-4cf1-87c7-f5a9b7d3edc2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:34.541029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 538/1111] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:34.546142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:34.546530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:34.546694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:34.565008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:34.566776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:34.614576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:34.631285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 574/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:34.895244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b2ba-49e0-4cf1-87c7-f5a9b7d3edc2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:34.994215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b2ba-49e0-4cf1-87c7-f5a9b7d3edc2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:34.996449 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:35.026304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:35.026926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:35.027204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:35.027475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] PATH_INFO: `/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:35.028872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] RBAC: Authorizing `identity:get_role(role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:35.030229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:35.031527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 539/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:34 2022] GET /identity/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:35.037754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:35.132011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0fac-5ab6-46fd-bba5-e661f53f8c81 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:35.165336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:35.165896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:35.166176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:35.166453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] PATH_INFO: `/v3/users/1e3c8abac4c842149462cd323e868b44` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:35.179223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] RBAC: Authorizing `identity:get_user(user_id=1e3c8abac4c842149462cd323e868b44)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:35.180689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:35.182306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 575/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:35 2022] GET /identity/v3/users/1e3c8abac4c842149462cd323e868b44 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:17:35.187910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:35.291125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad2ef-75b5-4490-a5c9-86801eae6b88 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:35.327252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:35.327854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:35.328137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:35.328414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:35.370584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:35.396792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:35.398222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:35.492647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 540/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:35.498598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:35.542790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:35.594910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1eb7-f720-486d-8fa8-ee1466d0d517 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:35.626422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:35.627030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:35.627307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:35.627579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:35.629184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:35.630581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7509-a2ab-476b-9a41-a05b157cba3e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:35.632156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 576/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:35 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:35.638137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:35.705221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:35.734516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a08797-dc3b-4f01-9d06-8cf50d936e54 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:35.767328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:35.767867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:35.768150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:35.768427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:35.769737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=db1c1812de0946eca8ae3349adcae4ec, user.id=1e3c8abac4c842149462cd323e868b44) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:35.770048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:35.771461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137755-0601-4e8f-850d-befd35f864bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:35.776643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 541/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:35 2022] GET /identity/v3/role_assignments?user.id=1e3c8abac4c842149462cd323e868b44&scope.project.id=db1c1812de0946eca8ae3349adcae4ec&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:37.898094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d90c5-f831-4425-b1d1-0e1a3e95e476 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:37.898651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d90c5-f831-4425-b1d1-0e1a3e95e476 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:37.898651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d90c5-f831-4425-b1d1-0e1a3e95e476 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:37.899943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 577/1118] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:37.905075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:37.905511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:37.905616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:37.923916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:37.925116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:37.988739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 542/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:38.258630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d90c5-f831-4425-b1d1-0e1a3e95e476 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:38.355238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d90c5-f831-4425-b1d1-0e1a3e95e476 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:38.368085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:38.388617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:38.389242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:38.389522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:38.389797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] PATH_INFO: `/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:38.391178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] RBAC: Authorizing `identity:get_role(role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:38.392520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:38.393893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 578/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:38 2022] GET /identity/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:38.399772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:38.462350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:38.497775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229b22-6429-4715-a7c0-e9894c9c4833 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:38.531161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:38.531792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:38.532076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:38.532353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] PATH_INFO: `/v3/users/1e3c8abac4c842149462cd323e868b44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:38.533492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] RBAC: Authorizing `identity:get_user(user_id=1e3c8abac4c842149462cd323e868b44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:38.535428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:38.537023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 543/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:38 2022] GET /identity/v3/users/1e3c8abac4c842149462cd323e868b44 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:38.542804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:38.638462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f28b-bf08-4796-aaa6-eda84e462124 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:38.671536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:38.672154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:38.672434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:38.672741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:38.673844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:38.675844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b79cb0-8027-4f79-942b-4f3f803ed386 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:38.677465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 579/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:38 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:38.683392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:38.778725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac4a7-2080-4dd2-8bd6-dfb2406558e8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:38.811365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:38.812005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:38.812289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:38.812592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec/users/1e3c8abac4c842149462cd323e868b44/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:38.814724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c1812de0946eca8ae3349adcae4ec, user_id=1e3c8abac4c842149462cd323e868b44, role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:38.816675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0056170-66ee-41e1-8bd4-100dcf8f8ecb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:38.818784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:38.829226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 544/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:17:38 2022] PUT /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec/users/1e3c8abac4c842149462cd323e868b44/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:17:40.939909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941046e-ec59-4267-8b5f-967e231cba44 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:40.941077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941046e-ec59-4267-8b5f-967e231cba44 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:40.941171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941046e-ec59-4267-8b5f-967e231cba44 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:40.942433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 580/1124] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:40.947676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:40.948048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:40.948229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:40.966539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:40.967989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:41.031561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 545/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:41.301510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941046e-ec59-4267-8b5f-967e231cba44 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:41.353191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:41.403345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941046e-ec59-4267-8b5f-967e231cba44 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:41.436045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:41.436692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:41.436971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:41.437242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] PATH_INFO: `/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:41.438578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] RBAC: Authorizing `identity:get_role(role_id=63b92bd3f73a41e9ac53ae73a0197d63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:41.439921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:41.441848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 581/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:41 2022] GET /identity/v3/roles/63b92bd3f73a41e9ac53ae73a0197d63 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:41.447617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:41.544300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868ce4-1719-4905-b152-ee8eefc5aafc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:41.567306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:41.578249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:41.578879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:41.579159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:41.579430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] PATH_INFO: `/v3/users/1e3c8abac4c842149462cd323e868b44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:41.580537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] RBAC: Authorizing `identity:get_user(user_id=1e3c8abac4c842149462cd323e868b44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:41.582029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:41.583600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 546/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:41 2022] GET /identity/v3/users/1e3c8abac4c842149462cd323e868b44 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:41.589459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:41.684998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e136d4a-77c9-46c4-9227-014f6a6fc850 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:41.700551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:41.718028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:41.718622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:41.718904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:41.719176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:41.783109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:41.785093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:41.878883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 582/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:41.884681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:41.980738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b701d0-07cc-4179-a70e-736cc862af52 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:42.013991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:42.014606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:42.014884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:42.015157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] PATH_INFO: `/v3/projects/db1c1812de0946eca8ae3349adcae4ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:42.016254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] RBAC: Authorizing `identity:get_project(project_id=db1c1812de0946eca8ae3349adcae4ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:42.017701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2248868-8b04-4ac9-8e4e-3ff3e5fea0aa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:42.019315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 547/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:41 2022] GET /identity/v3/projects/db1c1812de0946eca8ae3349adcae4ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:42.025349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:42.042121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:42.120097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da397-9217-43b7-a859-bca824e363b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:42.152419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:42.152978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:42.153255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:42.153522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:42.154222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] RBAC: Adding query filter params (role.id=63b92bd3f73a41e9ac53ae73a0197d63, scope.project.id=db1c1812de0946eca8ae3349adcae4ec, user.id=1e3c8abac4c842149462cd323e868b44) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:42.154527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:42.155905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510767-3a27-4239-bc4f-2e24cb143912 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:42.161425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 583/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:42 2022] GET /identity/v3/role_assignments?user.id=1e3c8abac4c842149462cd323e868b44&scope.project.id=db1c1812de0946eca8ae3349adcae4ec&role.id=63b92bd3f73a41e9ac53ae73a0197d63 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:44.302160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071956c-0458-4b1f-9e64-221d1f33caf8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:44.302685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071956c-0458-4b1f-9e64-221d1f33caf8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:44.302685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071956c-0458-4b1f-9e64-221d1f33caf8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:44.304039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 548/1131] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:44.309245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205265-88c2-450c-809d-93fc41024280 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:44.309654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205265-88c2-450c-809d-93fc41024280 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:44.309790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205265-88c2-450c-809d-93fc41024280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:44.328181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-70205265-88c2-450c-809d-93fc41024280 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:44.329450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-70205265-88c2-450c-809d-93fc41024280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:44.396726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 584/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:44.675717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071956c-0458-4b1f-9e64-221d1f33caf8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:44.737279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:44.792930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071956c-0458-4b1f-9e64-221d1f33caf8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:44.826725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:44.827352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:44.827630 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:44.827897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:44.829018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:44.830465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15302c54-157b-42b8-8e26-3fecd0cc8c6a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:44.832657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 549/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:44.838469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205265-88c2-450c-809d-93fc41024280 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:44.849923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:44.932523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205265-88c2-450c-809d-93fc41024280 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:44.964432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:44.965049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:44.965324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:44.965590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:44.966216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:44.967883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f395-ad72-487b-aa12-a9b2ecad1886 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:44.993441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 585/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:17:44 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:47.171685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21860d6-e87a-482a-b4a4-e192c0a576a4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:47.172222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21860d6-e87a-482a-b4a4-e192c0a576a4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:47.172222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21860d6-e87a-482a-b4a4-e192c0a576a4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:47.173616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 550/1135] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:47.179483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:47.179887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:47.180034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:47.198416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:47.199596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:47.254543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:47.265335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 586/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:47.533484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21860d6-e87a-482a-b4a4-e192c0a576a4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:47.631364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21860d6-e87a-482a-b4a4-e192c0a576a4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:47.658071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:47.665916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:47.666538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:47.666814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:47.667082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:47.668177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:47.669615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb0d43-e388-48d8-8158-dddfff98d7eb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:47.671150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 551/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:47.676952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:47.773526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60b1c-1428-43c7-9975-ac624325a0da None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:47.805568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:47.806111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:47.806391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:47.806664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:47.807313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:47.808760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15ec3-8c32-4643-8bb0-816420b310e9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:47.830235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 587/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:17:47 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:17:49.998396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9ec4-5127-44ba-9e05-8ba28bd24936 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:49.998946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9ec4-5127-44ba-9e05-8ba28bd24936 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:49.998946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9ec4-5127-44ba-9e05-8ba28bd24936 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:50.000265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 552/1139] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:50.005937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:50.006380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:50.006487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:50.024935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:50.026120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:50.067831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:50.091811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 588/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:50.359477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9ec4-5127-44ba-9e05-8ba28bd24936 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:50.456675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9ec4-5127-44ba-9e05-8ba28bd24936 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:50.489138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:50.489756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:50.490032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:50.490300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:50.499866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:50.504692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:50.505808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:50.506871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 553/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:50.511509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:50.609068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e985da3-84c5-4589-bdef-f95d22139b04 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:50.641746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:50.642301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:50.642620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:50.643491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:50.644257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:50.644593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:50.646163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:50.654736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 589/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:50.660520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:50.715250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:50.756963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddebb6-921f-4272-9688-cf9dfb63d1ae None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:50.789300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:50.789914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:50.790192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:50.790460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] PATH_INFO: `/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:50.802837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] RBAC: Authorizing `identity:get_user(user_id=49b9e626d2fe42cb88f56b3cf3ca6c53)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:50.804258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:50.805847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 554/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:50 2022] GET /identity/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:50.811538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:50.857241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:50.914096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb97a77-5d0c-45be-8285-1248c2eb941a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:50.946562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:50.947153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:50.947434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:50.947705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:51.011651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:51.013140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:51.051521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:51.108301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 590/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:51.114675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:51.209980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff899-bac2-48b9-8f91-bbf74ac7c919 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:51.223476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:51.243359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:51.243981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:51.244256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:51.244524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] PATH_INFO: `/v3/projects/517ba2810e2049a3aff677ce522f033a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:51.245629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] RBAC: Authorizing `identity:get_project(project_id=517ba2810e2049a3aff677ce522f033a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:51.247030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1e07-d190-4385-b9f5-d4f3728b1279 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:51.248636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 555/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:51 2022] GET /identity/v3/projects/517ba2810e2049a3aff677ce522f033a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:51.255241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:51.350817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94057895-bf31-4c94-b005-ba252b2a64be None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:51.383760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:51.384355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:51.384668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:51.384948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:51.385665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=517ba2810e2049a3aff677ce522f033a, user.id=49b9e626d2fe42cb88f56b3cf3ca6c53) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:51.385983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:51.387390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a7bff-66eb-4def-aff1-9ebe46e1d053 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:51.392504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 591/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:51 2022] GET /identity/v3/role_assignments?user.id=49b9e626d2fe42cb88f56b3cf3ca6c53&scope.project.id=517ba2810e2049a3aff677ce522f033a&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:53.500342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276036e-669e-4e2e-b5f1-0be234050e7d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:53.500885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276036e-669e-4e2e-b5f1-0be234050e7d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:53.500975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276036e-669e-4e2e-b5f1-0be234050e7d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:53.502912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 556/1147] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:53.508058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:53.508443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:53.508633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:53.515754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:53.526867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:53.528029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:53.592078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 592/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:53.859402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276036e-669e-4e2e-b5f1-0be234050e7d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:53.958526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276036e-669e-4e2e-b5f1-0be234050e7d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:53.991611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:53.992227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:53.992506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:53.992803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:54.003247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:54.008049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:54.009188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:17:54.010418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 557/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:54.015120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:54.110734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e043f5-ccdf-48a9-8d9b-b2f0af7e9d56 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:54.143105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:54.143691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:54.143967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:54.144239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:54.144915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:54.145215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:54.146552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:54.147839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:54.154940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 593/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:54.160584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:54.204182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:54.258457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32121f6a-6b2a-4dc2-94b9-4b6f86d71f82 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:54.291430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:54.292049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:54.292330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:54.292626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] PATH_INFO: `/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:54.293734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] RBAC: Authorizing `identity:get_user(user_id=49b9e626d2fe42cb88f56b3cf3ca6c53)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:54.295154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:54.296736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 558/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:54 2022] GET /identity/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:54.302601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:54.397978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93e8a-dd54-4741-8eab-f83273e78c1f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:54.428943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:54.429550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:54.429829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:54.430099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] PATH_INFO: `/v3/projects/517ba2810e2049a3aff677ce522f033a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:54.431187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] RBAC: Authorizing `identity:get_project(project_id=517ba2810e2049a3aff677ce522f033a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:54.432600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6bdb0-bd94-43ff-b7f9-421288827499 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:54.434173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 594/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:54 2022] GET /identity/v3/projects/517ba2810e2049a3aff677ce522f033a => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:54.440280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:54.535032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67def-f92a-416a-9ab8-0b8213d5a0cf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:54.545120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:54.568346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a143-4999-408b-9378-a21cea72452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:54.569012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a143-4999-408b-9378-a21cea72452d None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:54.569292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a143-4999-408b-9378-a21cea72452d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:54.569566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a143-4999-408b-9378-a21cea72452d None admin] PATH_INFO: `/v3/projects/517ba2810e2049a3aff677ce522f033a/users/49b9e626d2fe42cb88f56b3cf3ca6c53/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:54.571426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a143-4999-408b-9378-a21cea72452d None admin] RBAC: Authorizing `identity:create_grant(project_id=517ba2810e2049a3aff677ce522f033a, user_id=49b9e626d2fe42cb88f56b3cf3ca6c53, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:54.572853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a143-4999-408b-9378-a21cea72452d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:54.585484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 559/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:17:54 2022] PUT /identity/v3/projects/517ba2810e2049a3aff677ce522f033a/users/49b9e626d2fe42cb88f56b3cf3ca6c53/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:17:56.706409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa88b-b7c2-4a9f-b9d7-7996910729f7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:56.706979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa88b-b7c2-4a9f-b9d7-7996910729f7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:56.706979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa88b-b7c2-4a9f-b9d7-7996910729f7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:56.708264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 595/1154] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:17:56.713380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623196-e87b-4966-9225-730e7c23776f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:56.713772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623196-e87b-4966-9225-730e7c23776f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:56.713923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623196-e87b-4966-9225-730e7c23776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:56.732253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a1623196-e87b-4966-9225-730e7c23776f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:17:56.733442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a1623196-e87b-4966-9225-730e7c23776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:17:56.796802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 560/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:17:57.065209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa88b-b7c2-4a9f-b9d7-7996910729f7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:57.126813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:57.166573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa88b-b7c2-4a9f-b9d7-7996910729f7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:57.200696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:57.201325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:57.201608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:57.201883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:57.212259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:17:57.217103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:17:57.218531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:17:57.219428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 596/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:17:57.225022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623196-e87b-4966-9225-730e7c23776f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:57.317308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:57.320361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623196-e87b-4966-9225-730e7c23776f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:57.354285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:57.354885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:57.355165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:57.355439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:57.356102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:57.356406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:57.357785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:57.365435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 561/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:57.371220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:57.470325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f936-e58b-4ecd-b01e-1adc8caa5f9e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:57.492513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:57.503872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:57.504495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:57.504807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:57.505081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] PATH_INFO: `/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:57.506187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] RBAC: Authorizing `identity:get_user(user_id=49b9e626d2fe42cb88f56b3cf3ca6c53)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:57.507600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:57.509184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 597/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/users/49b9e626d2fe42cb88f56b3cf3ca6c53 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:57.514911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:57.610719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749a59-e43f-4b7b-8c6f-7bb14bf75362 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:57.642281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:57.643457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:57.643733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:57.644048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:57.671613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:57.708466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:57.709912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:57.806980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 562/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:17:57.812995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:57.907513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41c9-7621-4c7c-87f6-60d1f5c37427 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:57.939969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:57.940595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:57.940873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:57.941146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] PATH_INFO: `/v3/projects/517ba2810e2049a3aff677ce522f033a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:57.942233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] RBAC: Authorizing `identity:get_project(project_id=517ba2810e2049a3aff677ce522f033a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:57.943628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718edd09-e68c-4b57-a442-8ba3b40c507b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:57.945223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 598/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/projects/517ba2810e2049a3aff677ce522f033a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:17:57.951234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:17:58.010302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:17:58.047662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc72e8-f59c-4796-8c81-f03cbc24384e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:17:58.080278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:17:58.080893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:17:58.081174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:17:58.081447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:17:58.082157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=517ba2810e2049a3aff677ce522f033a, user.id=49b9e626d2fe42cb88f56b3cf3ca6c53) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:17:58.082472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:17:58.083908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be48b1-ba95-4d69-906f-66df3c46ff2e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:17:58.089493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 563/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:17:57 2022] GET /identity/v3/role_assignments?user.id=49b9e626d2fe42cb88f56b3cf3ca6c53&scope.project.id=517ba2810e2049a3aff677ce522f033a&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:00.249013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9097-ac3e-4856-b37c-068858271eb7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:00.249487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9097-ac3e-4856-b37c-068858271eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:00.249590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d9097-ac3e-4856-b37c-068858271eb7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:00.250873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 599/1162] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:00.256290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:00.256739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:00.256875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:00.275140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:00.276319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:00.344288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 564/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:00.607898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d9097-ac3e-4856-b37c-068858271eb7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:00.667480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:00.708468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d9097-ac3e-4856-b37c-068858271eb7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:00.741236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:00.741822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:00.742100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:00.742371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:00.805432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:00.806849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:00.862122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:00.902294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 600/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:18:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:18:00.908194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:00.961271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:01.004090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed377f-fae5-4f47-956d-b53a3105ce32 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:01.036617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:01.037232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:01.037509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:01.037778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:01.044219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:01.045663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0b8d7dcb-c9d2-46cc-bc63-3152b8d488fb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:18:01.057232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:18:01.058485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:18:01.059403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 565/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:18:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:18:01.064110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:01.160393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344b26-7125-4b65-8c10-ae2a9c526871 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:01.193665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:01.194267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:01.194549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:01.194824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:01.195460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:01.195763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:01.197148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead579f7-b63f-42db-a2f8-26f0ef8ce5aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:01.204022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 601/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Fri Sep 9 06:18:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:03.293492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc665-645a-4afb-b11d-2c58002c99ae None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:03.294042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc665-645a-4afb-b11d-2c58002c99ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:03.294042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc665-645a-4afb-b11d-2c58002c99ae None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:03.295370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 566/1167] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:03.300462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef3a-b7ca-4347-9bed-43cd42931d42 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:03.300944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef3a-b7ca-4347-9bed-43cd42931d42 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:03.301031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef3a-b7ca-4347-9bed-43cd42931d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:03.319151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bad4ef3a-b7ca-4347-9bed-43cd42931d42 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:03.320324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bad4ef3a-b7ca-4347-9bed-43cd42931d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:03.337678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:03.384592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 602/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:03.647374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc665-645a-4afb-b11d-2c58002c99ae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:03.746501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc665-645a-4afb-b11d-2c58002c99ae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:03.762258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:03.779714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916718-b232-48e8-b87c-960516cc58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:03.780306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916718-b232-48e8-b87c-960516cc58be None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:03.780609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916718-b232-48e8-b87c-960516cc58be None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:03.780887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916718-b232-48e8-b87c-960516cc58be None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:03.781542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916718-b232-48e8-b87c-960516cc58be None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:03.782911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916718-b232-48e8-b87c-960516cc58be None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:03.797983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 567/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Fri Sep 9 06:18:03 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:18:05.966232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697610-41f0-4232-a2f0-e43fe0b06120 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:05.966748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697610-41f0-4232-a2f0-e43fe0b06120 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:05.966748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697610-41f0-4232-a2f0-e43fe0b06120 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:05.968282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 603/1170] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:05.973661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:05.974053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:05.974213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:05.992391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:05.993605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:06.057647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 568/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:06.321715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697610-41f0-4232-a2f0-e43fe0b06120 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:06.418215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697610-41f0-4232-a2f0-e43fe0b06120 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:06.450328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:06.450940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:06.451216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:06.451485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] PATH_INFO: `/v3/domains/4ee4ca4ebd1a4a8e9ae15799de7db4f9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:06.461449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4ee4ca4ebd1a4a8e9ae15799de7db4f9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:06.462861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5cd88-1482-40f2-818f-65c2718ac907 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:06.464385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 604/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Fri Sep 9 06:18:06 2022] GET /identity/v3/domains/4ee4ca4ebd1a4a8e9ae15799de7db4f9 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:06.470715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:06.565032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5013-f8d5-46f9-9b6c-fef2059be6ae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:06.571997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:06.599755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:06.600357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:06.600666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:06.600944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:06.601586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:06.603004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d390725-638c-4a26-9aa6-779c9bb6011d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:06.629036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 569/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:18:06 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:18:08.781087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506ef8-449d-4aac-8899-0ab7fb44bd03 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:08.781617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506ef8-449d-4aac-8899-0ab7fb44bd03 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:08.781617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506ef8-449d-4aac-8899-0ab7fb44bd03 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:08.783436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 605/1174] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:08.788553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:08.788975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:08.789121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:08.807430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:08.808620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:08.872528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 570/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:09.140327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506ef8-449d-4aac-8899-0ab7fb44bd03 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:09.156543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:09.240288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506ef8-449d-4aac-8899-0ab7fb44bd03 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:09.272388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:09.273036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:09.273318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:09.273589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] PATH_INFO: `/v3/domains/4ee4ca4ebd1a4a8e9ae15799de7db4f9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:09.274690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4ee4ca4ebd1a4a8e9ae15799de7db4f9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:09.276096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613f35-2f8a-4fe9-8cf2-18b5012d2f7d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:09.277660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 606/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Fri Sep 9 06:18:09 2022] GET /identity/v3/domains/4ee4ca4ebd1a4a8e9ae15799de7db4f9 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:09.283899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:09.366803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:09.379146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e74e5-5f2c-4ab1-b0fd-656285d3b12a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:09.411325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:09.411854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:09.412129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:09.412397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:09.413068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:09.414465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254199e-bf13-4725-8e20-265398e2b587 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:09.436544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 571/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:18:09 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:18:11.601733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683343de-8d47-47ee-a7c4-7fb5a2a6e633 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:11.602280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683343de-8d47-47ee-a7c4-7fb5a2a6e633 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:11.602280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683343de-8d47-47ee-a7c4-7fb5a2a6e633 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:11.603602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 607/1178] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:11.608786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:11.609189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:11.609347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:11.627702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:11.628913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:11.694209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 572/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:11.959398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683343de-8d47-47ee-a7c4-7fb5a2a6e633 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.039082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:12.057223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683343de-8d47-47ee-a7c4-7fb5a2a6e633 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.089271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.089897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.090178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.090451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.101009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:18:12.105743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:18:12.106868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:18:12.108084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 608/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:18:12.112955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.184615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:12.210339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c3659-e4ea-4b1e-981f-ff2e3988d534 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.244145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.244772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.245057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.245335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.245994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:12.246303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:12.247670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:12.255439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 573/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:12.261362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.357535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd029ed-ff2a-4de0-a80d-fbd7744453b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.389623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.390231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.390511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.390782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] PATH_INFO: `/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.401854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:12.404182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=58c0a5966b5f4472ae8b58a4a1fd04cd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:12.405930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:12.408051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 609/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:18:12 2022] GET /identity/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:12.413417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.510068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75844c3a-933a-4acb-9550-2b676419bf58 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.542323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.542914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.543198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.543471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.546718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:12.607938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:12.609395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:12.703048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 574/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:18:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:18:12.708887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.804242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12c57-1105-4bda-9297-ddfbd1c75ac1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.836661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.837278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.837557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.837835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] PATH_INFO: `/v3/projects/192cd80e555b40218525fe7db732ac5d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.838933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=192cd80e555b40218525fe7db732ac5d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:12.840339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08451a-9f6a-410b-a265-c72a6b201ce9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:12.842202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 610/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:18:12 2022] GET /identity/v3/projects/192cd80e555b40218525fe7db732ac5d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:12.848159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:12.881612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:12.943822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5a73-37e7-43fb-a93b-48ecd4b32d98 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:12.977415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:12.978010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:12.978292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:12.978566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:12.979284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=192cd80e555b40218525fe7db732ac5d, user.id=58c0a5966b5f4472ae8b58a4a1fd04cd) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:12.979596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:12.981046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a7068-9a05-45d2-9b44-54dd06d95dd5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:12.986227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 575/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:18:12 2022] GET /identity/v3/role_assignments?user.id=58c0a5966b5f4472ae8b58a4a1fd04cd&scope.project.id=192cd80e555b40218525fe7db732ac5d&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:15.088305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916859-b50d-4d37-af37-2c0410f8083b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:15.088902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916859-b50d-4d37-af37-2c0410f8083b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:15.088902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df916859-b50d-4d37-af37-2c0410f8083b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:15.090212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 611/1186] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:15.096242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:15.096680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:15.096867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:15.114574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:15.115732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:15.180953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 576/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:15.446143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df916859-b50d-4d37-af37-2c0410f8083b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:15.511856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:15.546400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df916859-b50d-4d37-af37-2c0410f8083b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:15.583029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:15.583655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:15.583939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:15.584212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:15.594469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:18:15.599194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:18:15.600344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:18:15.601641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 612/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:18:15.606392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:15.635187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:15.702495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2142e-3879-42d2-ad9e-13ed42ce0113 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:15.734729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:15.735841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:15.736122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:15.736395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:15.737075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:15.737379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:15.738740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:15.746436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 577/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:15.752764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:15.847593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac2fd-a3c1-4e73-99c1-f52e84c805f3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:15.872702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:15.881084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:15.881696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:15.881973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:15.882241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] PATH_INFO: `/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:15.883324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] RBAC: Authorizing `identity:get_user(user_id=58c0a5966b5f4472ae8b58a4a1fd04cd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:15.884755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:15.886277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 613/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:18:15 2022] GET /identity/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:15.891951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:15.981527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:15.990778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015e59-bb7c-45d0-a9c6-93f770218e35 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:16.022948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:16.023566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:16.023846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:16.024124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] PATH_INFO: `/v3/projects/192cd80e555b40218525fe7db732ac5d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:16.025295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] RBAC: Authorizing `identity:get_project(project_id=192cd80e555b40218525fe7db732ac5d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:16.026710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb774bf-3332-43b3-ba92-ab4a563cead5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:16.028297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 578/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:18:15 2022] GET /identity/v3/projects/192cd80e555b40218525fe7db732ac5d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:16.034722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:16.132033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dac9a-1ed8-4263-9f7c-43675b8d02ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:16.164981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:16.165618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:16.165896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:16.166166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] PATH_INFO: `/v3/projects/192cd80e555b40218525fe7db732ac5d/users/58c0a5966b5f4472ae8b58a4a1fd04cd/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:16.167988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] RBAC: Authorizing `identity:create_grant(project_id=192cd80e555b40218525fe7db732ac5d, user_id=58c0a5966b5f4472ae8b58a4a1fd04cd, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:16.169513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499059-076c-4fdb-a739-1a4da70fef28 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:16.182272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 614/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:18:16 2022] PUT /identity/v3/projects/192cd80e555b40218525fe7db732ac5d/users/58c0a5966b5f4472ae8b58a4a1fd04cd/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:18:18.275245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aeb3a-d3db-462b-a7c5-3db0aed3ab7d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:18.275739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aeb3a-d3db-462b-a7c5-3db0aed3ab7d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:18.275828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aeb3a-d3db-462b-a7c5-3db0aed3ab7d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:18.277130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 579/1193] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:18:18.282754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:18.283141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:18.283295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:18.300813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:18:18.301971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:18:18.349887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:18.365705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 615/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:18:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:18:18.631313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aeb3a-d3db-462b-a7c5-3db0aed3ab7d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:18.728684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aeb3a-d3db-462b-a7c5-3db0aed3ab7d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:18.760998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:18.761607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:18.761884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:18.762155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:18.771724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:18:18.776418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:18:18.777533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:18:18.778778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 580/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:18:18.783400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:18.879204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bfe3-2cae-46fe-a61c-f404b9080a76 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:18.911190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:18.911726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:18.912008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:18.912279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:18.912965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:18.913269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:18.914613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:18.922275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 616/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:18.928396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:18.950214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:19.024079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b9a4-5281-4c4d-8725-eca72ca9c286 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:19.056317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:19.056947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:19.057225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:19.057496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] PATH_INFO: `/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:19.058592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] RBAC: Authorizing `identity:get_user(user_id=58c0a5966b5f4472ae8b58a4a1fd04cd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:19.060000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:19.061554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 581/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Fri Sep 9 06:18:18 2022] GET /identity/v3/users/58c0a5966b5f4472ae8b58a4a1fd04cd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:19.067654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:19.115255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:19.172268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9788e-8cab-4a83-91ac-c516b10a596f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:19.205383 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:19.205979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:19.206261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:19.206535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:19.270722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:19.272143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:19.316728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:19.366685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 617/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:18:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:18:19.372615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:19.455566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:19.467847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b99146-f0c7-48cc-aea8-b36a204f2e37 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:19.500747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:19.501360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:19.501636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:19.501906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] PATH_INFO: `/v3/projects/192cd80e555b40218525fe7db732ac5d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:19.502998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] RBAC: Authorizing `identity:get_project(project_id=192cd80e555b40218525fe7db732ac5d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:19.504419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d456c0-885b-4aaa-ab6c-7d22e85525f6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:19.506048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 582/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Fri Sep 9 06:18:19 2022] GET /identity/v3/projects/192cd80e555b40218525fe7db732ac5d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:19.511962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:18:19.611869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5408f-8669-42b9-90c5-e3bd32d95de8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:18:19.644290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:18:19.644913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:18:19.645195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:18:19.645468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:18:19.646198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=192cd80e555b40218525fe7db732ac5d, user.id=58c0a5966b5f4472ae8b58a4a1fd04cd) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:18:19.646509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:18:19.647911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577f8f5-1ac9-4484-9de1-ad459489474f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:18:19.653415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 618/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:18:19 2022] GET /identity/v3/role_assignments?user.id=58c0a5966b5f4472ae8b58a4a1fd04cd&scope.project.id=192cd80e555b40218525fe7db732ac5d&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:18:29.496771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=22 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:18:29.650904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:14.869577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568657d-e0a2-493b-b1fa-9efb0dd60e31 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:14.869577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568657d-e0a2-493b-b1fa-9efb0dd60e31 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:14.869577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568657d-e0a2-493b-b1fa-9efb0dd60e31 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:14.869577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 583/1201] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:14.876353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:14.876936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:14.876936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:14.896530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:14.897746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:14.987666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 619/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 06:19:15.263038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568657d-e0a2-493b-b1fa-9efb0dd60e31 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:15.398581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568657d-e0a2-493b-b1fa-9efb0dd60e31 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:15.438724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:15.439614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:15.440059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:15.440498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:15.451812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:15.453593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:15.473785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:15.475473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:15.476683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:15.476683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:15.476683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:15.476683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 584/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:15.481269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:15.599750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089c5cc-1589-43cb-b3d8-94d614e15e29 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:15.639022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:15.648082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:15.648737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:15.649016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:15.649295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:15.649941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:15.650249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:15.651701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088ec2e-683b-4bb5-ae21-95d54ce482ad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:15.664249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 620/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:15.670502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:15.747046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:15.813884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782b495-846c-470f-be86-3c3298dc2cc8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:15.866169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:15.866967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:15.868030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:15.868030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:15.868321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:15.870129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4778-d62c-435c-882b-5abb16dbb923 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:15.898540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 585/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Fri Sep 9 06:19:15 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:19:18.250199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a24d-806a-477b-b83e-fcd8f82a3fb5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:18.250869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a24d-806a-477b-b83e-fcd8f82a3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:18.250869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a24d-806a-477b-b83e-fcd8f82a3fb5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:18.252077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 621/1206] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:18.257729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:18.258215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:18.258310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:18.279593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:18.280826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:18.360260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 586/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:18.715647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a24d-806a-477b-b83e-fcd8f82a3fb5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:18.837680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a24d-806a-477b-b83e-fcd8f82a3fb5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:18.881223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:18.881914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:18.882264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:18.882555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:18.897448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:18.903129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:18.904151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:18.905109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 622/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:18.914923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:18.966738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:19.052846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f4d8-906d-4dc0-beb9-4eae45c047d2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:19.095331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:19.096085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:19.096490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:19.096947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:19.097644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:19.097956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:19.099676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:19.110980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 587/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:19.116875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:19.177093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:19.231108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd182fb-3e2b-440d-aae5-8c5b027bfc82 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:19.273143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:19.273935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:19.274050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:19.274293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:19.289468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:19.292052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:19.310178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:19.311304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:19.312695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:19.312695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:19.312695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:19.312695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 623/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:19:19.317087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:19.423587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:19.427432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8a88-16e7-4464-831e-6e47c00ce4e3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:19.465770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:19.466769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:19.467125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:19.467416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:19.468098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:19.468407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:19.470058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:19.490107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 588/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:19:19.491199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:19.610610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18f4d-bd11-48c4-8a5f-50373af09735 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:19.612525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:19.655842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:19.656848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:19.657250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:19.657692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:19.670506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:19.674140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:19.691289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:19.692520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:19.693904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:19.698712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 624/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:19:19.698904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:19.803677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a7b3b-fa5e-446e-9a0b-d2bdbbeac39d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:19.844583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:19.845275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:19.845562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:19.845834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:19.846592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:19.846901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:19.848341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:19.870266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 589/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:19.878166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:19.992147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195070-fc38-457b-a541-f49ca12f20a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:20.031899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:20.032724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:20.033099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:20.033470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:20.068304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:20.112131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:20.113759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:20.224270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 625/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:19:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:19:20.225705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:20.246251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:20.339951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3059-59fb-4405-9d95-bee8c20b0be6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:20.384469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:20.385135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:20.385414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:20.385686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:20.397018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:20.398610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:20.414176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:20.415347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:20.416267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:20.416267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:20.416267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:20.416267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 590/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:20.422221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:20.487873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:20.530295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116faec-331a-48c9-8c01-c60f480e2f0f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:20.567554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:20.568170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:20.568453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:20.568761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:20.569403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:20.569708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:20.571061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:20.584239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 626/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:19:20.590352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:20.670310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:20.708021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ddfee-15ec-4e2b-a676-28035c72e8ec None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:20.749996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:20.750639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:20.750911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:20.751184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:20.758127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:20.759535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:20.771185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:20.772193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:20.773176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 591/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:19:20.778422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:20.884300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c7aee-37f7-4966-b91f-5d57bbb6489b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:20.906542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:20.921475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:20.922086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:20.922363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:20.922636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:20.923324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:20.923632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:20.925112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0c206-5171-47a7-9f97-1655e2ca9fe9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:20.939524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 627/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:20.945992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:21.063208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35db1f-69b2-4ef0-9ba8-dc21b73a6940 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:21.110093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:21.118377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:21.119039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:21.119323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:21.119596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:21.120326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=7d2275234f9942e8bcf532855433d5ca) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:21.120677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:21.122098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe92c1c-f64c-4aa6-8968-7830a9bb1f50 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:21.128889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 592/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:19:20 2022] GET /identity/v3/role_assignments?user.id=7d2275234f9942e8bcf532855433d5ca&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:23.262593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045811-05a7-4bde-ace6-a0c1e2b5a44c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:23.263133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045811-05a7-4bde-ace6-a0c1e2b5a44c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:23.263213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045811-05a7-4bde-ace6-a0c1e2b5a44c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:23.265060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 628/1220] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:23.270422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:23.270872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:23.270965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:23.290963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:23.292136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:23.364863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 593/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:23.656841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045811-05a7-4bde-ace6-a0c1e2b5a44c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:23.772750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045811-05a7-4bde-ace6-a0c1e2b5a44c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:23.809089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:23.809724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:23.810031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:23.810906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:23.821763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:23.827672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:23.828902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:23.829909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 629/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:23.835182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:23.941000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8926d-2644-4122-908a-5e83d75d2df2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:23.965645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:23.977239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:23.977881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:23.978130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:23.978402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:23.979060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:23.979362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:23.980756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:23.990313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 594/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:19:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:23.996153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:24.047369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:24.108974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d5fab-1409-45b3-9a2f-d39561cab310 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:24.143510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:24.144222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:24.144502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:24.144804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:24.155521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:24.157385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:24.173027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:24.174105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:24.179929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:24.179929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:24.179929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:24.179929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 630/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:24.180179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:24.290255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bcfa-03ec-4379-b49c-0054c5a7a70f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:24.327814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:24.328485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:24.328766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:24.329038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:24.329674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:24.329977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:24.331422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:24.343407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 595/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:24.349502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:24.449374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:24.457807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490bed4-39c0-4ba3-8998-314965a77e79 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:24.495461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:24.496096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:24.496376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:24.496689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:24.504847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:24.506528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:24.518378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:24.519556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:24.520527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 631/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:24.525520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:24.575586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:24.637367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215074eb-d48b-41da-b414-f0f133a678ae None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:24.683367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:24.684104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:24.684461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:24.684912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:24.686323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:24.686672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:24.688646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:24.712428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 596/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:24.713646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:24.827241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c1-aee2-4373-a4e4-857be95dfff4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:24.863517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:24.864137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:24.864415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:24.864720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:24.877250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:24.878853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:24.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:24.897808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:24.899230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:24.899230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:24.899230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:24.899230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 632/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:24.904107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:25.015199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929b8db-438f-485d-9554-95474dc1afd8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:25.018324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:25.055756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:25.056536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:25.056866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:25.057196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:25.057898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:25.058296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:25.059681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:25.072622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 597/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:25.079777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:25.089856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:25.190884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423464-0eaa-44a6-803d-612d87d6b8b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:25.226570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:25.227246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:25.227562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:25.227879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:25.234858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:25.236288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:25.248409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:25.249580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:25.250519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 633/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:25.255676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:25.366841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df18d40-5b86-4c40-a068-6ae2a89d479d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:25.402168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:25.402775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:25.403056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:25.403330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:25.404643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:25.404958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:25.406382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15606-3a0f-4196-9130-a65c2f32e61a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:25.418883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 598/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:25.425183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:25.496240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:25.533954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6e88-27b4-4f3a-be3e-912716ea5e69 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:25.569066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:25.569719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:25.570033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:25.570303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/7d2275234f9942e8bcf532855433d5ca/roles/5bcfab62ab694f318015482daa9a6c44` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:25.586664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=7d2275234f9942e8bcf532855433d5ca, role_id=5bcfab62ab694f318015482daa9a6c44)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:25.588100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c734662-a85f-4c0d-af3d-391dcfb3beef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:25.602243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 634/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:19:25 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/7d2275234f9942e8bcf532855433d5ca/roles/5bcfab62ab694f318015482daa9a6c44 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:19:28.119547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ec5c-8600-4559-a963-41dab1f34d00 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:28.120277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ec5c-8600-4559-a963-41dab1f34d00 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:28.120277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ec5c-8600-4559-a963-41dab1f34d00 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:28.121463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 599/1233] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:19:28.126784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:28.127246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:28.127356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:28.147567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:28.148887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:28.225830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 635/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:28.519489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ec5c-8600-4559-a963-41dab1f34d00 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:28.546887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:28.631238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ec5c-8600-4559-a963-41dab1f34d00 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:28.672919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:28.673660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:28.673973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:28.674275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:28.686325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:28.691790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:28.693022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:28.694106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 600/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Fri Sep 9 06:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:19:28.702279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:28.753380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:28.812996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb783d32-9642-4ab4-9cda-202fde8261a8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:28.850421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:28.851100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:28.851387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:28.851661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:28.852420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:28.852857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:28.854232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:28.863058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 636/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Fri Sep 9 06:19:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:19:28.869080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:28.969707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:28.988398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2657e-d73f-4ee7-ad2a-24fed9ef5e11 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:29.028857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:29.029495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:29.029774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:29.030046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:29.040984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:29.042677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:29.061431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:29.062607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:29.063729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:29.063729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:29.063729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:29.063729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 601/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:29.068823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:29.183641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f38a-7d7a-4330-a4fa-205a01316a40 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:29.193110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:29.221307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:29.221939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:29.222222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:29.222504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:29.223150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:29.223450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:29.224894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:29.238178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 637/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:29.245390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:29.354482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0395-7ebd-492f-806b-b6575744ce80 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:29.389872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:29.390520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:29.390803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:29.391082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:29.393986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:29.400418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:29.401952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:29.413618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:29.414821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:29.416175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 602/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 06:19:29.421273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:29.524022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8d9f-ac2e-462f-9f89-3663ea29b64f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:29.557728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:29.558343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:29.558626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:29.558901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:29.559632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:29.560493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:29.561951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:29.579532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 638/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:29.585416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:29.713875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea89fe-9809-44b5-8ba1-3702542be72a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:29.756230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:29.756876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:29.757182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:29.757434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:29.824625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:29.833049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:29.834797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:29.949741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 603/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:19:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:19:29.956640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:29.984821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:30.060997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd8fc7-4edb-476c-9c8f-c348fc0033a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:30.099075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:30.102089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:30.102089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:30.102089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:30.113369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:30.114913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:30.130522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:30.136441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:30.137745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:30.137745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:30.137745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:30.137745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 639/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:30.138065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:30.244947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:30.251271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc45e-2f62-4531-a506-de6c0fa01958 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:30.286027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:30.288136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:30.288428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:30.288761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:30.289436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:30.289742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:30.291109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:30.302502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 604/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:19:30.310356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:30.403262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:30.426649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c67f9d-f2a3-4452-9874-193ece5dbe5c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:30.469888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:30.470885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:30.471375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:30.471748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:30.479838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:30.481466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:30.494136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:30.496144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:30.497918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 640/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:30.501819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:30.631441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525dba-ea47-42bf-b0a1-54ff51aafead None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:30.672605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:30.673272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:30.673591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:30.673904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:30.674698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:30.675087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:30.677135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe35f91-cf7c-4320-a441-5fcb3d8991f9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:30.693786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 605/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:30.700530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:30.819356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5bfc-679b-45fc-bd8b-8ac42a19e761 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:30.855974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:30.857117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:30.857434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:30.857682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:30.858403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] RBAC: Adding query filter params (role.id=5bcfab62ab694f318015482daa9a6c44, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=7d2275234f9942e8bcf532855433d5ca) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:30.858714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:30.860140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deacc9-a479-482a-9d47-ed3b45f61023 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:30.865977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 641/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:19:30 2022] GET /identity/v3/role_assignments?user.id=7d2275234f9942e8bcf532855433d5ca&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=5bcfab62ab694f318015482daa9a6c44 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:19:33.226947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351e-cbb7-4a8b-be15-af38d6b92749 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:33.227496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351e-cbb7-4a8b-be15-af38d6b92749 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:33.227496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276351e-cbb7-4a8b-be15-af38d6b92749 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:33.228882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 606/1247] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:33.234173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:33.234624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:33.234725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:33.240946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:33.256328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:33.257675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:33.330675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 642/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:33.612932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276351e-cbb7-4a8b-be15-af38d6b92749 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:33.632863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:33.741981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276351e-cbb7-4a8b-be15-af38d6b92749 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:33.785186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:33.785814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:33.786090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:33.786360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:33.798083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:33.805350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:33.806600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:33.807635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 607/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:33.814650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:33.921374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35194f4-a5bc-40ab-8fe1-185e0a0f4421 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:33.954340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:33.961244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:33.961974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:33.962278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:33.962589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:33.963355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:33.963696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:33.965380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:33.976591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 643/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:33.983287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:34.080766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:34.107328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658d8d7-129b-4d38-8f2e-15ba2a826d23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:34.144025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:34.144712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:34.144994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:34.145268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:34.156363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:34.157868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:34.174247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:34.175440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:34.176602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:34.176602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:34.176602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:34.176602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 608/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:34.183532 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:34.287539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d68a-ca04-4f0a-9268-ef71086a6b49 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:34.322041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:34.322692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:34.322969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:34.323237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:34.323881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:34.324184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:34.326227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:34.338990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 644/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:34.345124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:34.450359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fca7d-ee4e-464a-a1b8-e5b566112ec8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:34.490077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:34.500622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:34.501511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:34.501787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:34.502054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:34.509960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:34.511514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:34.522917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:34.524240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:34.525684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 609/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:34.529995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:34.586333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:34.632941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83716a99-f5c8-4c8a-a635-6272fee304b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:34.674872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:34.676330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:34.676656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:34.677388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:34.678448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:34.678970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:34.681761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:34.712547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 645/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:34.718832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:34.816037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a3d1-7769-478c-929c-85077d0e7d37 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:34.848317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:34.848934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:34.849212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:34.849478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:34.901399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:34.914011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:34.915435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.008588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 610/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:19:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:19:35.014612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:35.115657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f5d8-51d6-4101-8613-4aa098f6a987 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:35.128302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:35.149489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:35.150116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:35.150400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:35.150677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:35.160955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:35.162379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:35.177323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:35.178410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:35.179410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:35.179410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:35.179410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:35.179410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 646/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:35.184225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:35.268831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:35.281881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd7989-1230-4617-af62-7c756997bdc4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:35.314435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:35.315040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:35.315322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:35.315605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:35.316268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:35.316591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:35.317965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.329246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 611/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:35.334889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:35.430298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c231-d692-4d04-acca-21c8a1941218 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:35.461835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:35.462434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:35.462711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:35.462978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:35.470123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:35.471558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:35.482354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:35.483427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:35.484667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 647/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:35.489057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:35.586443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c9f7-9a8f-4dd6-ad31-c653c400e07c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:35.617921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:35.618507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:35.618783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:35.619050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:35.619720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:35.620020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:35.621440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36985-a3e7-4637-ad88-e40c93ebf261 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.633374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 612/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:35.639594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:35.667569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:35.744319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013aba-2e65-4001-9ffd-c5c3bbbaf016 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:35.776752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:35.777344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:35.777622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:35.777890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:35.779111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=7d2275234f9942e8bcf532855433d5ca) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:35.779418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:35.780842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783df3e8-205c-4a10-95d4-2cca237120ae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:35.787156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 648/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:19:35 2022] GET /identity/v3/role_assignments?user.id=7d2275234f9942e8bcf532855433d5ca&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:37.908467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778f74-4ba9-473b-ad71-1003b366a3a0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:37.909052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778f74-4ba9-473b-ad71-1003b366a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:37.909052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778f74-4ba9-473b-ad71-1003b366a3a0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:37.910385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 613/1261] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:37.915338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:37.915728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:37.915891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:37.933547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:37.935235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:37.999087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 649/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:38.264347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778f74-4ba9-473b-ad71-1003b366a3a0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:38.275057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:38.364611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778f74-4ba9-473b-ad71-1003b366a3a0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:38.397090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:38.397709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:38.397990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:38.398264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:38.407969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:38.412761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:38.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:38.414703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 614/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:38.420383 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:38.438932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:38.515724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5c7c8-0b0b-43ca-8e3f-c03cf13e70e7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:38.548165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:38.548794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:38.549079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:38.549353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:38.550009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:38.550314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:38.551659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:38.559299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 650/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:38.565404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:38.630157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:38.665828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5434dc9-7472-4548-bbfc-2a49155a0252 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:38.708921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:38.709484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:38.709761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:38.710032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:38.723259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:38.725318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:38.741708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:38.742870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:38.744012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:38.744012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:38.744012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:38.744012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 615/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:38.749286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:38.827434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:38.845947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744661-aa99-42d1-b014-e4994c16cbc2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:38.877881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:38.878476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:38.878761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:38.879025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:38.879655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:38.879958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:38.881329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:38.893350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 651/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:38.898855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:38.993824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56842f93-d936-462e-8dda-3275bc1d070c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.012843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:39.026513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.027125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.027406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.027678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.034753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.036168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:39.047396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:39.048504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:39.049884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 616/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:39.054164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.148033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac47e7-6fd4-4b8c-84e4-74e0e1e5d8ab None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.179989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.180589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.180880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.181148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.181863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:39.182161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.183566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.192300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:39.201325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 652/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:39.207010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.306361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753e284-93b0-4ff5-beaf-05a09f0a44ae None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.338351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.338973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.339254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.339528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.350428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.351864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:39.366257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:39.367421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:39.368719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:39.368719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:39.368719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:39.368719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 617/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:39.373139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.470027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cdd26-013b-4229-b41b-ea00b062ae12 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.502360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.502950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.503232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.503507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.504135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:39.504437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.505815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.516537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 653/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:39.522041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.553471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:39.619504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f472-a7c2-4157-b958-e7d2866446d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.651663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.652277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.652584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.652869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.660658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.662261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:39.674346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:39.675505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:39.676430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 618/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:39.681766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.741240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:39.781899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7e41d-21d2-4530-9447-a94f2ada1e7f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.821301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.822170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.822586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.822988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.824041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:39.824506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.826656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86434eb-6047-46a0-9dcf-52c8adc8b08c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.838295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 654/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:39.844990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:39.932546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:39.941656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b135d6b-eb0d-4af2-9f94-3193ba2f7864 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:39.974316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:39.974958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:39.975235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:39.975503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] PATH_INFO: `/v3/projects/c6b53515173d44938b161eee39ad33cc/users/7d2275234f9942e8bcf532855433d5ca/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:39.977370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] RBAC: Authorizing `identity:create_grant(project_id=c6b53515173d44938b161eee39ad33cc, user_id=7d2275234f9942e8bcf532855433d5ca, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:39.978779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9310df-8f4c-458a-8f19-7c6ff63de09e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:39.992083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 619/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Fri Sep 9 06:19:39 2022] PUT /identity/v3/projects/c6b53515173d44938b161eee39ad33cc/users/7d2275234f9942e8bcf532855433d5ca/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:19:42.083409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430583e-4ff6-4312-93dc-51012086d3a5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:42.083975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430583e-4ff6-4312-93dc-51012086d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:42.083975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430583e-4ff6-4312-93dc-51012086d3a5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:42.085282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 655/1274] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:42.090341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:42.091381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:42.091492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:42.110257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:42.111868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:42.177913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 620/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:42.441743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430583e-4ff6-4312-93dc-51012086d3a5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:42.539205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430583e-4ff6-4312-93dc-51012086d3a5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:42.556165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:42.572327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:42.572973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:42.573255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:42.573533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:42.583385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 06:19:42.588136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:42.589407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:42.591304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 656/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Fri Sep 9 06:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:42.595878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:42.676716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:42.700534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e49df-c708-4fb6-ac58-a8ebfb074dfe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:42.739395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:42.740087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:42.740378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:42.740678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:42.741338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:42.741642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:42.742992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:42.750862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 621/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Fri Sep 9 06:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:42.756739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:42.853818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90d0d-f23c-458a-a35f-b0904b55a4b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:42.885591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:42.886197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:42.886475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:42.886746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:42.896869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:42.898301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:42.912314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:42.913587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:42.914533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:42.914533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:42.914533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:42.914533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 657/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:42.919459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.016025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395644-68a6-4c58-80fe-4125ae64a667 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.048747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.049329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.049605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.049876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.050496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:43.050795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.052133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.063331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 622/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:43.068817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.098687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:43.165381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae464d1-db65-4005-991c-a26c697e1c03 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.197755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.198374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.198654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.198927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.209148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.210573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 06:19:43.222349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:43.223333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:43.224354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 658/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:43.229274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.233649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:43.324485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dffff-ee99-45ec-854b-d40db3f0f526 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.357524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.358110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.358390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.358659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.359371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:43.359673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.361104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.377229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 623/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:43.382893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.471370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:43.481260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d8ea7-08ea-4bac-9897-944c10e59f25 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.514952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.515560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.515842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.516112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.579997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.581395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.667345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:43.677644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 659/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 06:19:43.683423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.741766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:43.779434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d277-f128-4824-b879-c0a89f8ff8eb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.817225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.817851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.818129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.818397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.828694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.830176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 06:19:43.844386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:43.845540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 06:19:43.846678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 06:19:43.846678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 06:19:43.846678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:43.846678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 624/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:43.851216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:43.946031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621f72-4045-442a-a568-b9a4e0bfa784 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:43.979477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:43.980069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:43.980346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:43.980641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:43.981271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:43.981570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:43.982910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:43.993538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 660/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:43.999588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:44.094484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b5027-1bb7-412c-8481-cf9576046446 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:44.107212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:44.129997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:44.130637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:44.130914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:44.132718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:44.139122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:44.140551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 06:19:44.152134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:44.153426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 09 06:19:44.154331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 625/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Fri Sep 9 06:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:44.159262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:44.208476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:44.265309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d6e3c-4551-455d-914e-883f4eb0cc61 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:44.302963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:44.303564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:44.303848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:44.304124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:44.304841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:44.305154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:44.306562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346888a-05d2-4511-8a14-f3c0e365a977 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:44.319416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 661/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Fri Sep 9 06:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:44.325486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:44.422780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090c30c-b3e2-4358-92d3-196e1ead2241 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:44.456500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:44.457127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:44.457405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:44.457675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:44.458395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] RBAC: Adding query filter params (role.id=ab615789e49a44a7956ada7180efdd20, scope.project.id=c6b53515173d44938b161eee39ad33cc, user.id=7d2275234f9942e8bcf532855433d5ca) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:44.458702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:44.460123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fabdb-66ba-4fa5-8273-cb1cf7b784a5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:44.466058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 626/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Fri Sep 9 06:19:44 2022] GET /identity/v3/role_assignments?user.id=7d2275234f9942e8bcf532855433d5ca&scope.project.id=c6b53515173d44938b161eee39ad33cc&role.id=ab615789e49a44a7956ada7180efdd20 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:46.602440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18aa18-836b-4896-b006-15cc7eeb0317 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:46.602997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18aa18-836b-4896-b006-15cc7eeb0317 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:46.602997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18aa18-836b-4896-b006-15cc7eeb0317 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:46.604330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 662/1288] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:46.610029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:46.610433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:46.610568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:46.628928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:46.630102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:46.658953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:46.705975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 627/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:46.976172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18aa18-836b-4896-b006-15cc7eeb0317 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:47.072638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18aa18-836b-4896-b006-15cc7eeb0317 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:47.083218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:47.106295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:47.106910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:47.107187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:47.107457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:47.108030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:47.109397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:47.117822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:47.119061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:47.120124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 663/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:19:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:47.125317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:47.220660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de58f-277d-4a46-bcf0-b3106154875f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:47.253592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:47.254126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:47.254401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:47.254671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:47.255287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:47.255588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:47.256991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213c3aa-5939-49d8-a8d6-fc3d7fe330f7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:47.261636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 628/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Fri Sep 9 06:19:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:47.267379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:47.361959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818a806-a92b-4974-9b0f-f20530d86e20 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:47.393534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:47.394111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:47.394388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:47.394659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:47.395272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:47.395578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:47.396929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793fbc-8abd-420b-aca0-367e5a343075 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:47.401091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 664/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Fri Sep 9 06:19:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:49.519128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ce01-2f1f-4e2c-b3df-d707a85ba3f6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:49.519674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ce01-2f1f-4e2c-b3df-d707a85ba3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:49.519674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ce01-2f1f-4e2c-b3df-d707a85ba3f6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:49.521027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 629/1293] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:49.526256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca7f3-8994-46e2-9913-27333a2bc50a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:49.526649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca7f3-8994-46e2-9913-27333a2bc50a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:49.526822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca7f3-8994-46e2-9913-27333a2bc50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:49.545183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0c4ca7f3-8994-46e2-9913-27333a2bc50a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:49.546357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0c4ca7f3-8994-46e2-9913-27333a2bc50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:49.575054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:49.611255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 665/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:49.894812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ce01-2f1f-4e2c-b3df-d707a85ba3f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:49.924688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:49.992393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ce01-2f1f-4e2c-b3df-d707a85ba3f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:50.025095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:50.025684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:50.025960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:50.026229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:50.026876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:50.028244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66b48-0081-42ba-b521-69d1492aca6b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:50.041805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 630/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Fri Sep 9 06:19:49 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:19:52.176225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3ab4-fa10-4e78-b8da-e655ef8844d9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:52.176814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3ab4-fa10-4e78-b8da-e655ef8844d9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:52.176814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3ab4-fa10-4e78-b8da-e655ef8844d9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:52.178130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 666/1296] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:52.183592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:52.184011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:52.184173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:52.201698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:52.202861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:52.271633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 631/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:52.542305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3ab4-fa10-4e78-b8da-e655ef8844d9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:52.640382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3ab4-fa10-4e78-b8da-e655ef8844d9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:52.675556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:52.676356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:52.676728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:52.677179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:52.677908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:52.679541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:52.689849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:52.691141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:52.692264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 667/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:19:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:52.697005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:52.714627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:52.799518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf22a68-dd2b-4b94-9eed-0162d78a5530 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:52.833228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:52.833830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:52.834114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:52.834389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:52.835022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:52.835329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:52.836725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:52.842435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 632/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Fri Sep 9 06:19:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:52.848445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:52.879549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:52.944774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b448fe-20fd-4411-939e-abe24d534eb6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:52.976498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:52.977111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:52.977388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:52.977659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:52.978342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] RBAC: Adding query filter params (interface=public, service_id=f8dcffe5e12e4a7789d67da0848ed5e0, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:52.978647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:52.979981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cea109-bf9e-4bd0-b858-054e8c3187cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:52.985330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 668/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Fri Sep 9 06:19:52 2022] GET /identity/v3/endpoints?service_id=f8dcffe5e12e4a7789d67da0848ed5e0&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:52.990914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:53.069847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:53.087666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3981b-5d24-4c35-803b-1ffa71f77d20 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:53.125823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:53.126428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:53.126711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:53.126985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:53.127591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:53.128983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e09f39-adb6-4663-baba-4abdb4c89c81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:53.135691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 633/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Fri Sep 9 06:19:52 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:19:55.238942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602448-0314-4f15-a81c-15f6ee8799bb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:55.239446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602448-0314-4f15-a81c-15f6ee8799bb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:55.239548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602448-0314-4f15-a81c-15f6ee8799bb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:55.240864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 669/1302] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:19:55.246005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:55.246948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:55.247069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:55.265186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:19:55.266345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:19:55.329577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 634/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:19:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 06:19:55.596129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602448-0314-4f15-a81c-15f6ee8799bb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:55.687397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:55.694269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602448-0314-4f15-a81c-15f6ee8799bb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:55.727677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:55.728298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:55.728606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:55.728887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:55.729464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:55.730843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 06:19:55.739379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 06:19:55.740585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Sep 09 06:19:55.741589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 670/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Sep 9 06:19:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 06:19:55.746289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:55.819709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:19:55.842925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e63854-0a70-49e8-8c35-e266aef7957f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:55.875538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:55.876088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:55.876368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:55.876675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:55.877306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:19:55.877614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:55.878973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb141-546c-45a1-8e93-546143695f20 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:55.883886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 635/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Fri Sep 9 06:19:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:19:55.890032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:19:55.988085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a471e1-9242-4eb8-81e5-2c98001a49f0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:19:56.020290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:19:56.020910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:19:56.021194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:19:56.021469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:19:56.022137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:19:56.023489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72d71a-cd46-4bca-a74b-b74bfe516bd5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:19:56.042527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 671/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:19:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:20:05.881398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=30 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:20:06.038436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:20:59.499447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4dcf-3cf0-4335-a49d-4274d2f80a45 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:20:59.499914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4dcf-3cf0-4335-a49d-4274d2f80a45 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:20:59.500149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4dcf-3cf0-4335-a49d-4274d2f80a45 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:20:59.501386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 636/1307] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:20:59.507183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f99a-ef2d-42f8-a12b-80f076343078 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:20:59.507609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f99a-ef2d-42f8-a12b-80f076343078 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:20:59.507977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7f99a-ef2d-42f8-a12b-80f076343078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:20:59.611452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-51c7f99a-ef2d-42f8-a12b-80f076343078 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:20:59.612669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-51c7f99a-ef2d-42f8-a12b-80f076343078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:20:59.762070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 672/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:00.056242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:00.056617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:00.056820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:00.058351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 637/1309] 10.222.0.30 () {54 vars in 965 bytes} [Fri Sep 9 06:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:00.064537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb642a9-7fe7-478e-8d72-73f31d3a16b3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:00.065062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb642a9-7fe7-478e-8d72-73f31d3a16b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:00.065418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb642a9-7fe7-478e-8d72-73f31d3a16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:00.148843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aeb642a9-7fe7-478e-8d72-73f31d3a16b3 None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:00.150406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aeb642a9-7fe7-478e-8d72-73f31d3a16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:00.172856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:00.249146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 673/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Fri Sep 9 06:21:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:00.258774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:00.260743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:00.382267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990d17-92e2-46c5-aa40-58d24bddf574 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:00.460911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:00.461530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:00.461811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:00.462084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:00.463675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:00.520863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:00.581617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:00.583047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8343ea-5189-4914-a7a9-6ddf1f8719b3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:00.608864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 638/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:03.155306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:03.155762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:03.155954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:03.157531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 674/1312] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:03.162763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a79f7-aacf-4d87-81a9-e80fd9732c62 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:03.163217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a79f7-aacf-4d87-81a9-e80fd9732c62 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:03.163319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a79f7-aacf-4d87-81a9-e80fd9732c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:03.236997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-979a79f7-aacf-4d87-81a9-e80fd9732c62 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:03.238064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-979a79f7-aacf-4d87-81a9-e80fd9732c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:03.332291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 639/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:03.620165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:03.621749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:03.726158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbff43-32a0-441a-928e-2f9790753ee6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:03.796909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:03.799161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:03.799990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:03.800447 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:03.800960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:03.802566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:03.911578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:03.912970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b797bea-ac23-45c8-9249-a66b4acbd8b0 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:03.930701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 675/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:06.377806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a609-79d9-49d3-8e8b-3b6e99538c96 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:06.378368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a609-79d9-49d3-8e8b-3b6e99538c96 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:06.378368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6a609-79d9-49d3-8e8b-3b6e99538c96 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:06.379698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 640/1315] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:06.385015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7f46-d591-4f19-91f5-e033c10bbd01 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:06.385433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7f46-d591-4f19-91f5-e033c10bbd01 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:06.385575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7f46-d591-4f19-91f5-e033c10bbd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:06.450570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ba7c7f46-d591-4f19-91f5-e033c10bbd01 None None] MFA Rules not processed for user `6fe0e2991c7c4d1ab242aeb7bff85053`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:06.452287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ba7c7f46-d591-4f19-91f5-e033c10bbd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:06.502503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:06.547804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 676/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:06.848473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:06.848780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:06.849063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:06.850386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 641/1317] 10.222.0.30 () {54 vars in 965 bytes} [Fri Sep 9 06:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:06.856201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50c87-a774-4add-abf7-d321b590c57d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:06.856489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50c87-a774-4add-abf7-d321b590c57d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:06.856801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50c87-a774-4add-abf7-d321b590c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:06.930129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67d50c87-a774-4add-abf7-d321b590c57d None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:06.931309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67d50c87-a774-4add-abf7-d321b590c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:07.004913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 677/1318] 10.222.0.30 () {58 vars in 1062 bytes} [Fri Sep 9 06:21:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:07.014504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:07.016012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:07.025477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:07.117176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406836d5-4f7c-4c8c-93cb-b4bb36cc8938 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:07.202635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:07.203297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:07.203576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:07.203872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:07.205516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:07.266861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:07.312140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:07.313593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135df747-8852-4111-8a8d-9ef29e2694a4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:07.332863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 642/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:10.407569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:10.408120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:10.408120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:10.409471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 678/1320] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:10.414695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45e9c-2885-477c-ba41-404e65c5eb14 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:10.415089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45e9c-2885-477c-ba41-404e65c5eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:10.415253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45e9c-2885-477c-ba41-404e65c5eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:10.483676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-05a45e9c-2885-477c-ba41-404e65c5eb14 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:10.484937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05a45e9c-2885-477c-ba41-404e65c5eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:10.580412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 643/1321] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:21:10.865479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:10.867048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:10.917383 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:10.971422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a0e73-c18c-44e6-babf-9a4287292363 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:11.042623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:11.043217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:11.043498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:11.043766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:11.045932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:11.138379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:11.151781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:11.153228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4816-49c2-4ece-b11e-f8307c7186c8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:11.171755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 679/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:14.043086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:14.043656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:14.043755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:14.045719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 644/1323] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:14.051246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07b81-7e9b-4070-90aa-07e18a2bcf31 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:14.051641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07b81-7e9b-4070-90aa-07e18a2bcf31 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:14.051965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f07b81-7e9b-4070-90aa-07e18a2bcf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:14.125998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-78f07b81-7e9b-4070-90aa-07e18a2bcf31 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:14.127221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-78f07b81-7e9b-4070-90aa-07e18a2bcf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:14.237406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 680/1324] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:14.521369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:14.522923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:14.543067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:14.626713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25d866-fcee-4ca1-a7f0-deae43e40d75 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:14.706438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:14.707051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:14.707333 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:14.707609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:14.709238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:14.779118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:14.818660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:14.820102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee2983-b9f3-42a7-bb7b-ae989bc6f1b2 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:14.839008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 645/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:17.073858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:17.074429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:17.074429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:17.075765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 681/1326] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:17.080985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf604-6cb2-4e98-b478-bad4641f2b91 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:17.081376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf604-6cb2-4e98-b478-bad4641f2b91 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:17.081545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf604-6cb2-4e98-b478-bad4641f2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:17.159953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ec8cf604-6cb2-4e98-b478-bad4641f2b91 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:17.161207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec8cf604-6cb2-4e98-b478-bad4641f2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:17.262298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 646/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:17.544071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:17.545636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:17.606510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:17.650282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678302a6-d660-45cc-9cfe-8181650e7c4c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:17.726271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:17.726870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:17.727146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:17.727416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:17.729025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:17.835283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:17.837976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:17.840165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf9243-80fb-40ba-8b47-165cf2527bca service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:17.858471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 682/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:20.055207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:20.055725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:20.055725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:20.057104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 647/1329] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:20.062652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366c1e-98aa-4154-8df9-ce01c6d8b4ac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:20.063075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366c1e-98aa-4154-8df9-ce01c6d8b4ac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:20.063221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366c1e-98aa-4154-8df9-ce01c6d8b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:20.130661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4e366c1e-98aa-4154-8df9-ce01c6d8b4ac None None] MFA Rules not processed for user `6fe0e2991c7c4d1ab242aeb7bff85053`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:20.131862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e366c1e-98aa-4154-8df9-ce01c6d8b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:20.228543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 683/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:20.510941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:20.512480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:20.549610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:20.621932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0f6e9-2ca7-455a-a7d0-d178b9fb20e5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:20.703321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:20.703933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:20.704212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:20.704484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:20.706128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:20.781797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:20.814641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:20.816084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ea9e3-51f0-4991-ab84-130387a1cca4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:20.834215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 648/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:23.267699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:23.268261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:23.268261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:23.269823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 684/1332] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:23.275351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df50107-add0-4efe-8573-20d0a0c7fae8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:23.275915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df50107-add0-4efe-8573-20d0a0c7fae8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:23.276188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df50107-add0-4efe-8573-20d0a0c7fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:23.343313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3df50107-add0-4efe-8573-20d0a0c7fae8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:23.344509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3df50107-add0-4efe-8573-20d0a0c7fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:23.440419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 649/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:21:23.725487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:23.727029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:23.796336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:23.829467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b69ab-30b7-4b13-aa02-29877f77aa49 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:23.902341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:23.902936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:23.903216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:23.903489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:23.905713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:24.010264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:24.011689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e73d1b-d16e-4f57-b8d5-06763fb90065 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:24.021914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:24.031323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 685/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:26.213194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:26.213645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:26.213797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:26.215187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 650/1335] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:26.220450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62339bd-bc9b-4868-9c12-ed3ca74f8aa7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:26.220910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62339bd-bc9b-4868-9c12-ed3ca74f8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:26.221295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62339bd-bc9b-4868-9c12-ed3ca74f8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:26.287910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e62339bd-bc9b-4868-9c12-ed3ca74f8aa7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:26.289167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e62339bd-bc9b-4868-9c12-ed3ca74f8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:26.385699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 686/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:26.670988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:26.672513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:26.716091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:26.777754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b413983-8a19-43c9-a6e8-d330592d1442 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:26.848694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:26.849296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:26.849570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:26.849839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:26.851433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:26.931571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:26.957134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:26.958570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340947dc-2ae9-427a-927a-a9651cf5d51b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:26.977236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 651/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:29.456173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:29.456702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:29.456702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:29.458046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 687/1338] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:29.463229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ef06-5b5e-4743-9074-d19fe7b94bb7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:29.463651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ef06-5b5e-4743-9074-d19fe7b94bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:29.463779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ef06-5b5e-4743-9074-d19fe7b94bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:29.528816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2ec0ef06-5b5e-4743-9074-d19fe7b94bb7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:29.530620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ec0ef06-5b5e-4743-9074-d19fe7b94bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:29.626685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 652/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:29.909580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:29.911119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:29.987346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:30.014853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3c71-c42b-43cf-a5ea-2811566f496e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:30.087343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:30.087948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:30.088227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:30.088497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:30.090104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:30.198239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:30.199701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003535-a8d4-4178-93cc-40bb1b21347c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:30.218435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 688/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:34.270599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:34.271200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:34.271200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:34.272493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 653/1341] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:21:34.277658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e80eb-0cc5-41de-9076-5e3e8d9f2df7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:34.278072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e80eb-0cc5-41de-9076-5e3e8d9f2df7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:34.278220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e80eb-0cc5-41de-9076-5e3e8d9f2df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:34.283693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:34.344326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9e4e80eb-0cc5-41de-9076-5e3e8d9f2df7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:34.345453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9e4e80eb-0cc5-41de-9076-5e3e8d9f2df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:34.445410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 689/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:34.727944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:34.729538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:34.778131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:34.833037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839709f-5498-4dbc-a185-997956a6d8cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:34.905459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:34.906067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:34.906338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:34.906604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:34.908171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:35.001925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:35.019667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:35.021139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fba2f0-0607-453c-b5ad-69e6281fab14 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:35.038716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 654/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:37.933689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:37.934223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:37.934223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:37.935478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 690/1344] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:37.940587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dd32-b835-44aa-ae03-d430b0dd1285 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:37.941002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dd32-b835-44aa-ae03-d430b0dd1285 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:37.941285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dd32-b835-44aa-ae03-d430b0dd1285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:38.007561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9357dd32-b835-44aa-ae03-d430b0dd1285 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:38.008801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9357dd32-b835-44aa-ae03-d430b0dd1285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:38.107114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 655/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:38.388191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:38.390381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:38.485614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:38.502325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c344ee-51b8-49e5-95ce-2420f856e182 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:38.579290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:38.579900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:38.580182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:38.580462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:38.582086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:38.696704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:38.698142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7391793-ac94-4dee-8928-f56a5dc723d5 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:38.721244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 691/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:43.030626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:43.031140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:43.031140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:43.032706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 656/1347] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:43.038008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bc21c-4075-4528-a313-97b79d602a53 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:43.038444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bc21c-4075-4528-a313-97b79d602a53 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:43.038555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bc21c-4075-4528-a313-97b79d602a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:43.055085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:43.108688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d36bc21c-4075-4528-a313-97b79d602a53 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:43.109919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d36bc21c-4075-4528-a313-97b79d602a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:43.215659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 692/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:43.511706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:43.513300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:43.570471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:43.616504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c8d3-20c0-4131-b1ad-d54292f723fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:43.689932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:43.690468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:43.690750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:43.691029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:43.692644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:43.802029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:43.806485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:43.809573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418fc7-71c3-45c8-87e4-c5800be23ee4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:43.828623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 657/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:21:48.748374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc95-dd9a-435b-b5fe-2334f87dc455 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:48.749612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc95-dd9a-435b-b5fe-2334f87dc455 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:48.749895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc95-dd9a-435b-b5fe-2334f87dc455 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:48.751413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 693/1350] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:48.756459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f1f2-a6ed-426a-8996-2cfcf203a0c9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:48.756959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f1f2-a6ed-426a-8996-2cfcf203a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:48.757043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f1f2-a6ed-426a-8996-2cfcf203a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:48.913926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3843f1f2-a6ed-426a-8996-2cfcf203a0c9 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:48.915365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3843f1f2-a6ed-426a-8996-2cfcf203a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:49.034298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 658/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:21:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 09 06:21:52.982278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73132a0-d76e-4fda-84b5-14f95b3fc74a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:52.982864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73132a0-d76e-4fda-84b5-14f95b3fc74a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:52.982864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73132a0-d76e-4fda-84b5-14f95b3fc74a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:52.984483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 694/1352] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:52.989521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e8d1-c668-4ad8-9937-c271b6b22d45 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:52.989944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e8d1-c668-4ad8-9937-c271b6b22d45 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:52.990068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e8d1-c668-4ad8-9937-c271b6b22d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:53.046685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:53.071124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-14b1e8d1-c668-4ad8-9937-c271b6b22d45 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:53.072316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-14b1e8d1-c668-4ad8-9937-c271b6b22d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:53.188972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 659/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:53.211371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=59 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:54.726102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc32e-3557-4a55-836b-37e9fcea96a7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:54.726730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc32e-3557-4a55-836b-37e9fcea96a7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:54.726730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc32e-3557-4a55-836b-37e9fcea96a7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:54.727989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 695/1354] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:54.733647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7525-3426-42e8-acb7-5a91b6a3cbda None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:54.734105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7525-3426-42e8-acb7-5a91b6a3cbda None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:54.734204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd7525-3426-42e8-acb7-5a91b6a3cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:54.809580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c4dd7525-3426-42e8-acb7-5a91b6a3cbda None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:54.811357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c4dd7525-3426-42e8-acb7-5a91b6a3cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:54.853072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:54.920225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 660/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:21:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:21:58.526711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3889f9-2cd7-460a-9a25-320053537af0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:58.527294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3889f9-2cd7-460a-9a25-320053537af0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:58.527294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3889f9-2cd7-460a-9a25-320053537af0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:58.528781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 696/1356] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:58.534042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663350a-21ec-4b36-9d6f-88390a5e2a5f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:58.534464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663350a-21ec-4b36-9d6f-88390a5e2a5f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:58.534652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663350a-21ec-4b36-9d6f-88390a5e2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:58.607078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7663350a-21ec-4b36-9d6f-88390a5e2a5f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:58.609074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7663350a-21ec-4b36-9d6f-88390a5e2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:58.736676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 661/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:59.065091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:59.065681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:59.066284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:59.068930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 697/1358] 10.222.0.30 () {54 vars in 962 bytes} [Fri Sep 9 06:21:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:21:59.077239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc9f7-2cff-4695-8ecf-fbdcd060abe8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:59.077532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc9f7-2cff-4695-8ecf-fbdcd060abe8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:59.077811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc9f7-2cff-4695-8ecf-fbdcd060abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:59.101656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:59.165365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-908dc9f7-2cff-4695-8ecf-fbdcd060abe8 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:21:59.166605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-908dc9f7-2cff-4695-8ecf-fbdcd060abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:59.320123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 662/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Sep 9 06:21:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:21:59.327789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:21:59.329393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:59.480845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444a2c7-247b-4c56-a897-a34a7e04b432 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:21:59.561348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:21:59.609084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:21:59.609609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:21:59.609884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:21:59.610149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:21:59.611707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:21:59.720441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:21:59.722165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09fe59-8ff4-4e0b-a81b-f1054f6a1a2c service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:21:59.744476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 698/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:02.126992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:02.127498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:02.127657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:02.132616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 663/1361] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:02.134205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4c1a-afd4-4322-9554-b83d8269ee1a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:02.134650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4c1a-afd4-4322-9554-b83d8269ee1a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:02.134795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4c1a-afd4-4322-9554-b83d8269ee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:02.212036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7f6c4c1a-afd4-4322-9554-b83d8269ee1a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:02.213292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7f6c4c1a-afd4-4322-9554-b83d8269ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:02.253961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:02.324636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 699/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:22:02.612706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:02.614361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:02.699587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:02.803534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc2109-3958-4947-8402-77cac1d49a2c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:02.921821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:02.922591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:02.922929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:02.923412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:02.926249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:02.951846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:03.024713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:03.026360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bee58-fac3-4352-91e5-0ede57bb1973 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:03.044846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 664/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:05.563784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaff54-0aa4-4a95-b73f-6e3a7dbec2e3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:05.564407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaff54-0aa4-4a95-b73f-6e3a7dbec2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:05.564407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaff54-0aa4-4a95-b73f-6e3a7dbec2e3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:05.565727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 700/1364] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:05.571344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf900ed-7ac8-4262-98b0-329f4686263c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:05.571822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf900ed-7ac8-4262-98b0-329f4686263c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:05.571928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf900ed-7ac8-4262-98b0-329f4686263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:05.682424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3cf900ed-7ac8-4262-98b0-329f4686263c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:05.683674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3cf900ed-7ac8-4262-98b0-329f4686263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:05.794863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:05.800619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 665/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:06.089559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:06.089848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:06.090127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:06.091441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 701/1366] 10.222.0.30 () {54 vars in 962 bytes} [Fri Sep 9 06:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:06.096954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb803b-af43-4e72-b9e5-6db91f7537ad None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:06.097240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb803b-af43-4e72-b9e5-6db91f7537ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:06.097775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb803b-af43-4e72-b9e5-6db91f7537ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:06.179651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bbeb803b-af43-4e72-b9e5-6db91f7537ad None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:06.179651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bbeb803b-af43-4e72-b9e5-6db91f7537ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:06.311153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 666/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Sep 9 06:22:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:06.319028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:06.320513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:06.489846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d94f8-63a0-400d-90ea-525cef6a1c09 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:06.512006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:06.621190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:06.621968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:06.622370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:06.622770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:06.625122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:06.663762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe8b8-e48d-4e63-b846-478950ed9c5f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:06.664326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe8b8-e48d-4e63-b846-478950ed9c5f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:06.664326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe8b8-e48d-4e63-b846-478950ed9c5f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:06.665886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 667/1368] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:22:06.671729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b697f-5f67-4c42-b801-bb83b149c615 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:06.672014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b697f-5f67-4c42-b801-bb83b149c615 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:06.672305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b697f-5f67-4c42-b801-bb83b149c615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:06.729997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:06.731691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a9f7f-6cb4-4d23-bf5f-87f2cb892bca service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:06.735467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:06.743714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-581b697f-5f67-4c42-b801-bb83b149c615 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:06.744894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-581b697f-5f67-4c42-b801-bb83b149c615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:06.752085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 702/1369] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:22:06.869712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 668/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:07.212255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:07.212480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:07.212879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:07.214457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 703/1371] 10.222.0.30 () {54 vars in 964 bytes} [Fri Sep 9 06:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:07.219572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58406-2832-4c14-bc70-fd44c2152f42 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:07.220019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58406-2832-4c14-bc70-fd44c2152f42 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:07.220394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58406-2832-4c14-bc70-fd44c2152f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:07.299744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1ad58406-2832-4c14-bc70-fd44c2152f42 None None] MFA Rules not processed for user `4fdc7998a54c420c920fc0e54b91b930`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:07.301128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ad58406-2832-4c14-bc70-fd44c2152f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:07.393335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:07.408604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:07.408998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 669/1372] 10.222.0.30 () {58 vars in 1061 bytes} [Fri Sep 9 06:22:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:07.410446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:07.444442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:07.526145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd858-030b-4954-a33b-8b1336aafc1e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:07.614015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:07.614749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:07.615034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:07.615305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:07.616933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:07.739994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:07.785973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:07.788463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54506d-5e82-44fe-86af-ac73aafbcec5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:07.812944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 704/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:22:08.982254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:08.982825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:08.982825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:08.984272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 670/1374] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:08.989550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02fcb-a938-4ed5-8c7e-29c90646ecc8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:08.989944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02fcb-a938-4ed5-8c7e-29c90646ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:08.990220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02fcb-a938-4ed5-8c7e-29c90646ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:09.059331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9b02fcb-a938-4ed5-8c7e-29c90646ecc8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:09.060539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9b02fcb-a938-4ed5-8c7e-29c90646ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:09.157382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 705/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:09.449006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:09.450590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:09.614135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225f7ce-7f34-439b-b636-8fb0b8d9ca63 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:09.683992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:09.733018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:09.733636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:09.733919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:09.734187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:09.735786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:09.838170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:09.839697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc6b01-be2f-47e2-a600-ecfe5018a3fb service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:09.859598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 671/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:12.092509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:12.093091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:12.093091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:12.094823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 706/1377] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:12.100204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee646ca-302f-44f3-ad2b-c0c30a6fda3a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:12.100647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee646ca-302f-44f3-ad2b-c0c30a6fda3a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:12.100884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee646ca-302f-44f3-ad2b-c0c30a6fda3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:12.170826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bee646ca-302f-44f3-ad2b-c0c30a6fda3a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:12.172363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bee646ca-302f-44f3-ad2b-c0c30a6fda3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:12.214115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:12.285181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 672/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:12.578250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:12.579914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:12.619661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:12.741362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7c488-b81f-49ee-ab6a-7a1edfa12080 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:12.854001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:12.860265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:12.861020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:12.861406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:12.861784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:12.863449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:12.958136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:12.959913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa3600-b1a5-48c8-a285-c4fc890582c2 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:12.981794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 707/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:15.221462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:15.221883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:15.222036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:15.223776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 673/1380] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:15.229071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d530-bd3e-4285-a9ef-8b897a5f058e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:15.229486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d530-bd3e-4285-a9ef-8b897a5f058e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:15.229784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d530-bd3e-4285-a9ef-8b897a5f058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:15.332879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4ec9d530-bd3e-4285-a9ef-8b897a5f058e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:15.333793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4ec9d530-bd3e-4285-a9ef-8b897a5f058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:15.407426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:15.441658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 708/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:15.731588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:15.733739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:15.908057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e82e9-d1d9-4106-85aa-fca92ec454fd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:15.921704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:16.026604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:16.027233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:16.027530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:16.027802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:16.029550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:16.123226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:16.124943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423d26a-b8df-4b8c-bca3-093396b4d10b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:16.145914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 674/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:18.621448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:18.622000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:18.622202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:18.623907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 709/1383] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:18.629342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33501-44d4-43ff-8a1b-fcd840551e90 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:18.629820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33501-44d4-43ff-8a1b-fcd840551e90 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:18.629820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33501-44d4-43ff-8a1b-fcd840551e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:18.651523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:18.700955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8df33501-44d4-43ff-8a1b-fcd840551e90 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:18.702307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8df33501-44d4-43ff-8a1b-fcd840551e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:18.809654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 675/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:19.157844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:19.160019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:19.326141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8fd1-f916-4e20-8824-41244f83000d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:19.384382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:19.450563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:19.451354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:19.451709 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:19.452062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:19.454228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:19.549669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:19.551276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100ad20-3440-4d04-b50e-c9146dbd3888 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:19.569479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 710/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:21.921962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:21.922524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:21.922524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:21.923858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 676/1386] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:21.929370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0cf9a-b8a0-47da-9a37-6b02f6382b2c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:21.929773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0cf9a-b8a0-47da-9a37-6b02f6382b2c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:21.929925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0cf9a-b8a0-47da-9a37-6b02f6382b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:21.998794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15b0cf9a-b8a0-47da-9a37-6b02f6382b2c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:22.000048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15b0cf9a-b8a0-47da-9a37-6b02f6382b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:22.008333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:22.109473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 711/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:22.396417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:22.398089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:22.501969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:22.578184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda656-4de8-47ad-a34c-255ea928c074 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:22.699804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:22.700238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:22.700524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:22.700953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:22.703078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:22.767574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:22.799702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:22.801410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c8b2d-34de-464b-9df6-918ad94608c0 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:22.819612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 677/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:24.828804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a9db-d29f-4e13-9974-885a25e6fc86 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:24.829442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a9db-d29f-4e13-9974-885a25e6fc86 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:24.829442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a9db-d29f-4e13-9974-885a25e6fc86 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:24.830701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 712/1389] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:24.835976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484df6-aa2b-4790-bd50-8481b3009f15 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:24.836441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484df6-aa2b-4790-bd50-8481b3009f15 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:24.836549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484df6-aa2b-4790-bd50-8481b3009f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:24.905790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-98484df6-aa2b-4790-bd50-8481b3009f15 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:24.907041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-98484df6-aa2b-4790-bd50-8481b3009f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.009237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 678/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:25.032890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f049-b264-44f5-b09f-bc9ce1c32906 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.033174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f049-b264-44f5-b09f-bc9ce1c32906 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.033445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f049-b264-44f5-b09f-bc9ce1c32906 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.034793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 713/1391] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:25.039979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3e7f-daa5-4230-812c-da3093618682 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.040271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3e7f-daa5-4230-812c-da3093618682 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.040553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3e7f-daa5-4230-812c-da3093618682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.086802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:25.109496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d6ba3e7f-daa5-4230-812c-da3093618682 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:25.110709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d6ba3e7f-daa5-4230-812c-da3093618682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.216628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 679/1392] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:25.316007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.316291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.316582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.317951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 714/1393] 10.222.0.30 () {54 vars in 966 bytes} [Fri Sep 9 06:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:25.323163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.323451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.323727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.400864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] MFA Rules not processed for user `572694e1f16040bea41fa0445501d01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:25.401985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.457913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:25.478926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 680/1394] 10.222.0.30 () {58 vars in 1063 bytes} [Fri Sep 9 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:25.488449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:25.490022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.511927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:25.513307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.601953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae9cc-5bde-4167-830c-5f64861dc323 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:25.638449 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679394b1-b5b0-43dd-a194-5ab39492c886 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:25.640583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:25.678498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:25.679129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.679407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.679678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.681311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.722799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:25.754841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:25.755443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:25.755718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:25.755994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:25.757631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:25.793984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:25.796024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea066eb-7e94-455f-977c-a76aeb1d7693 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:25.813990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 715/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:25.848392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:25.850004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5781a-c7e1-4b05-98b6-7abe43a9a86b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:25.868646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 681/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:26.574645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738abb1-4b48-450c-8bd9-f6fcb0ba52e3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:26.575178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738abb1-4b48-450c-8bd9-f6fcb0ba52e3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:26.575289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738abb1-4b48-450c-8bd9-f6fcb0ba52e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:26.642541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5738abb1-4b48-450c-8bd9-f6fcb0ba52e3 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:26.643727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5738abb1-4b48-450c-8bd9-f6fcb0ba52e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:26.662978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:26.734804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 716/1397] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:26.775362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:26.775645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:26.775918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:26.777468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 682/1398] 10.222.0.30 () {54 vars in 943 bytes} [Fri Sep 9 06:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:26.784365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6b70-9fea-4766-9821-fd0c661db701 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:26.784699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6b70-9fea-4766-9821-fd0c661db701 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:26.784983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6b70-9fea-4766-9821-fd0c661db701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:26.865185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-083c6b70-9fea-4766-9821-fd0c661db701 None None] MFA Rules not processed for user `10878995ca2b405e975f1929d737a2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:26.866380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-083c6b70-9fea-4766-9821-fd0c661db701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:26.960991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:26.971979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 717/1399] 10.222.0.30 () {58 vars in 1040 bytes} [Fri Sep 9 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:26.981521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:26.983526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:27.077160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:27.119297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2180f50-8f9b-4e62-b2f1-4c5a09216734 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:27.231330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:27.231944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:27.232787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:27.233071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:27.234709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:27.316250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:27.318669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:27.320921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc725-5483-4763-9f54-58b14b1bd32a service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:27.329859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 683/1400] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:22:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:22:28.078528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:28.079101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:28.079101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:28.080467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 718/1401] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:28.086159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b80b3-28c7-417b-b3bf-615cce6ce298 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:28.086593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b80b3-28c7-417b-b3bf-615cce6ce298 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:28.086742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b80b3-28c7-417b-b3bf-615cce6ce298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:28.157184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-029b80b3-28c7-417b-b3bf-615cce6ce298 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:28.158391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-029b80b3-28c7-417b-b3bf-615cce6ce298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:28.276603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 684/1402] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:28.564553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:28.565905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:28.743831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d530e1-d807-42b5-b7a6-a96d7d995a59 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:28.814309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:28.872018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:28.872656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:28.872977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:28.873257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:28.874868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:28.976327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:28.978015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108dd2-4f75-4d7f-9fd2-58adfb5c7d5d service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:29.006245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 719/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:31.320804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:31.321382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:31.321382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:31.322664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 685/1404] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:31.327880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5d6b-2d28-4502-bc2c-7d76f2a9b7fd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:31.328315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5d6b-2d28-4502-bc2c-7d76f2a9b7fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:31.328429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5d6b-2d28-4502-bc2c-7d76f2a9b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:31.396930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4a0c5d6b-2d28-4502-bc2c-7d76f2a9b7fd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:31.398155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4a0c5d6b-2d28-4502-bc2c-7d76f2a9b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:31.431075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:31.525091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 720/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:31.821411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:31.823235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:31.908289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:31.982229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2806c-6243-496a-b49a-008ad2b857d8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:32.105976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:32.106505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:32.107124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:32.107430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:32.109071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:32.151866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:32.218024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:32.219901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9212c2-885a-4e63-8179-69aec611fc2a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:32.242555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 686/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:34.432364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:34.432965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:34.432965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:34.434285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 721/1407] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:34.440488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf302bd-e3a0-4895-95fd-508df6dce525 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:34.440936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf302bd-e3a0-4895-95fd-508df6dce525 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:34.441037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf302bd-e3a0-4895-95fd-508df6dce525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:34.512413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-baf302bd-e3a0-4895-95fd-508df6dce525 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:34.513838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-baf302bd-e3a0-4895-95fd-508df6dce525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:34.632720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 687/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:34.917900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:34.920155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:35.084129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574995-a9d0-463f-a95a-889d4e1af40d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:35.097962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:35.215261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:35.215982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:35.216262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:35.216555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:35.218692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:35.322299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:35.323898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738791d2-acb9-443a-8a87-a6ec779c9c41 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:35.342924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 722/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:44.625366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:45.340677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:50.456417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd4f5-57ec-4c5a-bec1-e7ebfa758964 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:50.457177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd4f5-57ec-4c5a-bec1-e7ebfa758964 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:50.457177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd4f5-57ec-4c5a-bec1-e7ebfa758964 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:50.458408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 688/1410] 10.222.0.30 () {54 vars in 918 bytes} [Fri Sep 9 06:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:50.463757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bca21-22fd-4e41-b511-263feac80ff4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:50.464189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bca21-22fd-4e41-b511-263feac80ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:50.464306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bca21-22fd-4e41-b511-263feac80ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:50.540127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-958bca21-22fd-4e41-b511-263feac80ff4 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:50.541395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-958bca21-22fd-4e41-b511-263feac80ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:50.646251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 723/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 9 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:50.660210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5f524-2799-4862-bfc0-dfdd8d33239e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:50.660499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5f524-2799-4862-bfc0-dfdd8d33239e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:50.660811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5f524-2799-4862-bfc0-dfdd8d33239e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:50.662133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 689/1412] 10.222.0.30 () {54 vars in 918 bytes} [Fri Sep 9 06:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:50.666556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d873a0-48bc-4cb0-9e56-1d338830c3c5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:50.666842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d873a0-48bc-4cb0-9e56-1d338830c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:50.667117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d873a0-48bc-4cb0-9e56-1d338830c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:50.739548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:50.742242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e4d873a0-48bc-4cb0-9e56-1d338830c3c5 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:50.744038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4d873a0-48bc-4cb0-9e56-1d338830c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:50.858957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 724/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Sep 9 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:53.397558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:53.398117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:53.398117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:53.399432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:53.405564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8e42-0577-40cc-9960-7f793ef501cf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:53.405967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8e42-0577-40cc-9960-7f793ef501cf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:53.406118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8e42-0577-40cc-9960-7f793ef501cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:53.472753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6acc8e42-0577-40cc-9960-7f793ef501cf None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:53.474144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6acc8e42-0577-40cc-9960-7f793ef501cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:53.527715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:53.570133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:53.858117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:53.859863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:54.008194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296130-ea7d-4d4d-ac18-644666be0aa1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:54.079643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:54.120136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:54.120705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:54.120984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:54.121255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:54.123513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:54.215656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:54.217313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390fe7d-4ef5-4603-ba52-1749a4cbb0b7 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:54.236091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 691/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:55.378651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:55.379252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:55.379252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:55.380520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:55.386686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54de96-604a-4488-92f9-80fd8e899446 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:55.387159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54de96-604a-4488-92f9-80fd8e899446 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:55.387293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54de96-604a-4488-92f9-80fd8e899446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:55.461957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9a54de96-604a-4488-92f9-80fd8e899446 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:55.463073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a54de96-604a-4488-92f9-80fd8e899446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:55.489670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:55.559032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:22:55.712883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:55.714328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:55.857528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815aed0-fa2e-4a96-8245-306c943b2309 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:55.906832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:55.979226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:55.979829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:55.980108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:55.980377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:55.981996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:56.069102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:56.070678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134271d-9aa7-469d-9588-e12d0b65a117 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:56.088925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 727/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:57.241272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:57.241670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:57.241767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:57.243101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:57.249952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567799c-904c-40a7-84f6-5016c8533989 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:57.250402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567799c-904c-40a7-84f6-5016c8533989 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:57.250512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567799c-904c-40a7-84f6-5016c8533989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:57.305095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:57.326780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2567799c-904c-40a7-84f6-5016c8533989 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:57.327960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2567799c-904c-40a7-84f6-5016c8533989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:57.422897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:57.573331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:57.574883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:57.720547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fc878-8085-407f-b34c-ef8db0434213 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:57.733071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:57.832955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:57.833483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:57.833761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:57.834037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:57.835646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:57.924346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:57.925967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5ed49-1ad7-4ed3-b682-f56740448a0c service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:57.943348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 694/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:59.049687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:59.050276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:59.050276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:59.051595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:22:59.057740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7078df-57c8-41f7-9444-f40cce6d82e4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:59.058157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7078df-57c8-41f7-9444-f40cce6d82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:59.058293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7078df-57c8-41f7-9444-f40cce6d82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:59.078778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:59.134677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b7078df-57c8-41f7-9444-f40cce6d82e4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:22:59.135877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b7078df-57c8-41f7-9444-f40cce6d82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:59.230954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:22:59.380305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:22:59.381768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:59.490428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:59.525704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c574b5-1f9c-4e0b-98d5-1e441fd0b22b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:22:59.635367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:22:59.635933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:22:59.636215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:22:59.636492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:22:59.638167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:22:59.716716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:59.731298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:22:59.733491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e718e0-e06e-4c08-8585-db4447d0070e service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:22:59.751076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 730/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:00.869920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:00.870482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:00.870482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:00.871832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:00.878275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a430-5c80-4d7d-aa1d-b9df6924e8d4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:00.878729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a430-5c80-4d7d-aa1d-b9df6924e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:00.878845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a430-5c80-4d7d-aa1d-b9df6924e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:00.953881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0171a430-5c80-4d7d-aa1d-b9df6924e8d4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:00.955107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0171a430-5c80-4d7d-aa1d-b9df6924e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:01.051268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:01.203409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:01.205000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:01.295262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:01.356938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb47d-87d1-4623-b21b-32abdaea5e3f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:01.467794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:01.468390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:01.468693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:01.468966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:01.470584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:01.521384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:01.563625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:01.565276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5666173-2f1d-41a2-8104-9c11aeeb16bb service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:01.583577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 697/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:02.639936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:02.640507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:02.640507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:02.641872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:02.648039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661001-909f-4819-99ee-c84a3ecb2faa None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:02.648478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661001-909f-4819-99ee-c84a3ecb2faa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:02.648616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661001-909f-4819-99ee-c84a3ecb2faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:02.724573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-67661001-909f-4819-99ee-c84a3ecb2faa None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:02.725803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67661001-909f-4819-99ee-c84a3ecb2faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:02.820133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:02.972513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:02.974294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:03.022298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:03.119481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe62ad-0a85-4f42-b4a3-90a0f719508e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:03.233188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:03.233795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:03.234078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:03.234353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:03.235946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:03.242837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:03.447445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:03.449056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10027d-09ea-411e-bd8e-ede9dd251931 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:03.467317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 733/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:04.524705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:04.525193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:04.525301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:04.526609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:04.533125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3498-10ff-4213-858e-ee8401496681 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:04.533580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3498-10ff-4213-858e-ee8401496681 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:04.533679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f3498-10ff-4213-858e-ee8401496681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:04.607727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ca6f3498-10ff-4213-858e-ee8401496681 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:04.608953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ca6f3498-10ff-4213-858e-ee8401496681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:04.675176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:04.704030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:04.854015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:04.855515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:04.873121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:04.999389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d958fc-70f8-4bd4-b9dc-4d4e6da10844 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:05.085353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:05.112189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:05.112756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:05.113039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:05.113309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:05.114901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:05.203452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:05.205099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77f90-620b-4a3d-9054-33da27cd245b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:05.223499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 700/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:06.282298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:06.282854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:06.282854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:06.284195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:06.290503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca05-f348-4757-adf3-8f9b31deeb76 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:06.290914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca05-f348-4757-adf3-8f9b31deeb76 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:06.291048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca05-f348-4757-adf3-8f9b31deeb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:06.366957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0d4cca05-f348-4757-adf3-8f9b31deeb76 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:06.368216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0d4cca05-f348-4757-adf3-8f9b31deeb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:06.411615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:06.466113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:06.615918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:06.617484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:06.764035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06064077-ac49-45df-931f-b1a0dc0c7568 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:06.818080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:06.878223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:06.878823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:06.879101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:06.879367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:06.880996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:06.966986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:06.968557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7201301-3d50-4370-b88c-b171ab61f600 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:06.986582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 736/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:08.049963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:08.050552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:08.050552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:08.051862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:08.057955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b701e-6bbe-4522-a6a8-9e27bace58ab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:08.058409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b701e-6bbe-4522-a6a8-9e27bace58ab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:08.058520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b701e-6bbe-4522-a6a8-9e27bace58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:08.133182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7f2b701e-6bbe-4522-a6a8-9e27bace58ab None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:08.134396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7f2b701e-6bbe-4522-a6a8-9e27bace58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:08.136379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:08.235550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:08.387531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:08.389531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:08.532167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5a31-56ca-4975-bb75-6db19ae81f0c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:08.558241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:08.644300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:08.644842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:08.645121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:08.645390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:08.646983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:08.739231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:08.740901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a04a6-ca4b-4740-826f-f4f6f77972cb service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:08.758897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 703/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:10.867718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:10.868266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:10.868266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:10.869626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:10.875357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9457b-5c9c-4e85-87bc-660b6f51ff23 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:10.875818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9457b-5c9c-4e85-87bc-660b6f51ff23 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:10.875926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9457b-5c9c-4e85-87bc-660b6f51ff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:10.915838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:10.940917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-21e9457b-5c9c-4e85-87bc-660b6f51ff23 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:10.942145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-21e9457b-5c9c-4e85-87bc-660b6f51ff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:11.036290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:11.323082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:11.324627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:11.428971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7bca2-7935-4b9a-9a86-46d439d8ffdf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:11.461023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:11.504364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:11.504990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:11.505273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:11.505549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:11.507144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:11.630928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:11.632918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3517f3-2def-42b8-9f1b-730e1d2c2b88 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:11.651977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 739/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:13.981460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:13.982045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:13.982045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:13.983533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:13.988517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fde6-9bcc-493b-9833-ccc16774db8e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:13.988977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fde6-9bcc-493b-9833-ccc16774db8e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:13.989093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fde6-9bcc-493b-9833-ccc16774db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:14.053768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f852fde6-9bcc-493b-9833-ccc16774db8e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:14.054966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f852fde6-9bcc-493b-9833-ccc16774db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:14.067860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:14.150004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:14.429756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:14.431293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:14.535032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41a6e2-7833-486f-b79e-4db5e6c67e29 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:14.547752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:14.608337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:14.608961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:14.609241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:14.609511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:14.611085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:14.720517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:14.721928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0af5c-0661-4957-a560-d58ff342e390 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:14.740221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 706/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:17.195126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:17.195565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:17.195681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:17.197049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:17.202833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed839-5299-427c-a806-d19fbe27f406 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:17.203271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed839-5299-427c-a806-d19fbe27f406 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:17.203379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eed839-5299-427c-a806-d19fbe27f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:17.251624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:17.270829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-05eed839-5299-427c-a806-d19fbe27f406 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:17.272048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05eed839-5299-427c-a806-d19fbe27f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:17.366901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:23:17.651841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:17.653438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:17.756483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72031d-1dc9-41f4-ab06-ad1b68046da3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:17.796015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:17.830218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:17.830815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:17.831092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:17.831360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:17.832961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:17.939624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:17.941014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92da8ad-69c5-470a-b48b-370003f5434c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:17.958268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 742/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:20.209670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:20.210102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:20.210221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:20.211550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:20.217551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b5d1-3f9d-4f43-89ad-0f927a45b1af None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:20.217993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b5d1-3f9d-4f43-89ad-0f927a45b1af None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:20.218141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b5d1-3f9d-4f43-89ad-0f927a45b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:20.284113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4d25b5d1-3f9d-4f43-89ad-0f927a45b1af None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:20.285356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d25b5d1-3f9d-4f43-89ad-0f927a45b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:20.307047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:20.382175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:20.666900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:20.668433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:20.772551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcad2fc-aed5-4f61-ad45-67646ed61cc3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:20.793289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:20.846025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:20.846626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:20.846903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:20.847179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:20.848801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:20.963838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:20.965563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208115-4726-4f97-8d02-1a4638534e6d service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:20.983886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 709/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:23.154421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:23.154969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:23.154969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:23.156297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:23.161855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b731f4-54be-47da-82e5-541da6d02871 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:23.162266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b731f4-54be-47da-82e5-541da6d02871 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:23.162407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b731f4-54be-47da-82e5-541da6d02871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:23.227196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:23.229875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e5b731f4-54be-47da-82e5-541da6d02871 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:23.232175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e5b731f4-54be-47da-82e5-541da6d02871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:23.328722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:23.616150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:23.617721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:23.720900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99715066-68be-48f8-84c2-ac45f233ab44 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:23.769395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:23.793656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:23.794263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:23.794543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:23.794866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:23.796482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:23.906298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:23.907637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242acacb-77c1-4cbb-9496-919c2382a417 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:23.926316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 745/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:26.157688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:26.158338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:26.158338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:26.159644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:26.164958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a390-90e2-49ea-8dbd-64a2970c9b2b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:26.165408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a390-90e2-49ea-8dbd-64a2970c9b2b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:26.165556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202a390-90e2-49ea-8dbd-64a2970c9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:26.231240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6202a390-90e2-49ea-8dbd-64a2970c9b2b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:26.233009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6202a390-90e2-49ea-8dbd-64a2970c9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:26.261869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:26.331207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:26.616065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:26.617634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:26.742536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0839-ff0d-422c-ab56-b9b5698d2eb3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:26.770479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:26.815689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:26.816292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:26.816584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:26.816862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:26.818435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:26.925085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:26.926433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111229-9a6f-4e38-818e-db34a15e1750 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:26.945358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 712/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:23:29.187614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:29.188008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:29.188164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:29.189546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:29.194949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088d72-6417-407b-91cd-5cb1ee98ef24 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:29.195368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088d72-6417-407b-91cd-5cb1ee98ef24 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:29.195505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74088d72-6417-407b-91cd-5cb1ee98ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:29.261365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74088d72-6417-407b-91cd-5cb1ee98ef24 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:29.262613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74088d72-6417-407b-91cd-5cb1ee98ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:29.270903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:29.360668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:29.646455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:29.648011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:29.753592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50de33-4aa9-47e4-8fc1-8a61b8dd35d8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:29.808400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:29.827173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:29.827771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:29.828047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:29.828316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:29.829912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:29.937583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:29.938904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028510a-4283-4510-9b41-d71a0e78d343 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:29.956193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 748/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:32.158046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:32.158616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:32.158616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:32.159930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:32.170724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4ba3-4a85-482d-81cb-6803ae480065 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:32.171227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4ba3-4a85-482d-81cb-6803ae480065 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:32.171438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4ba3-4a85-482d-81cb-6803ae480065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:32.237162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f18e4ba3-4a85-482d-81cb-6803ae480065 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:32.238353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f18e4ba3-4a85-482d-81cb-6803ae480065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:32.275986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:32.334699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:23:32.618776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:32.620355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:32.722664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b66db-296f-4ce1-9bb9-d04174199438 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:32.759892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:32.795376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:32.795975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:32.796250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:32.796515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:32.798114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:32.904924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:32.906301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f27f6-9d81-4a12-a488-7bc38a4aa17b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:32.924218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 715/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:35.088442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535990a-7541-4187-af5f-c0815506d937 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:35.089043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535990a-7541-4187-af5f-c0815506d937 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:35.089043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535990a-7541-4187-af5f-c0815506d937 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:35.090411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:35.096255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68601-d6ca-4864-b89b-93185aa84d1a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:35.096713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68601-d6ca-4864-b89b-93185aa84d1a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:35.096884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd68601-d6ca-4864-b89b-93185aa84d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:35.162469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cfd68601-d6ca-4864-b89b-93185aa84d1a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:35.163646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cfd68601-d6ca-4864-b89b-93185aa84d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:35.181315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:35.261289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:35.544734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535990a-7541-4187-af5f-c0815506d937 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:35.546290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b535990a-7541-4187-af5f-c0815506d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:35.648276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535990a-7541-4187-af5f-c0815506d937 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:35.714711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:35.721667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:35.722268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:35.722547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:35.722824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:35.724687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:35.831474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:35.832841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa19f-ca52-4437-8f86-5ac337bf2ccd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:35.850484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 751/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:38.009938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:38.010515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:38.010515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:38.011838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:38.018080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e12f-63e3-4aa7-9a9b-41691a63ed04 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:38.018510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e12f-63e3-4aa7-9a9b-41691a63ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:38.018613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e12f-63e3-4aa7-9a9b-41691a63ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:38.083719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-96b6e12f-63e3-4aa7-9a9b-41691a63ed04 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:38.084943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-96b6e12f-63e3-4aa7-9a9b-41691a63ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:38.133643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:38.182285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:38.461614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:38.463157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:38.682037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c13dc-463c-4d75-b67a-73435edaebf9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:38.731465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:38.757410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:38.758012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:38.758290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:38.758557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:38.760183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:38.866451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:38.867867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea87d6-3d93-4d4a-abd3-05b1e93bf2ac service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:38.886323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 718/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:48.180696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=22 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:48.884247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=66 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:58.827531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949949a2-4677-47e6-9b12-139826ddf40e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:58.828127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949949a2-4677-47e6-9b12-139826ddf40e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:58.828127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949949a2-4677-47e6-9b12-139826ddf40e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:58.829446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 753/1471] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:23:58.835123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09bdc-7268-478e-bdb5-7188b9695a1b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:58.835572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09bdc-7268-478e-bdb5-7188b9695a1b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:58.835691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09bdc-7268-478e-bdb5-7188b9695a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:58.900598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5eb09bdc-7268-478e-bdb5-7188b9695a1b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:58.901811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5eb09bdc-7268-478e-bdb5-7188b9695a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:58.995747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 719/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:59.298872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:59.299158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:59.299431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:59.300812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 754/1473] 10.222.0.30 () {54 vars in 966 bytes} [Fri Sep 9 06:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:23:59.305617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce5b5b-ecea-4cfa-8119-e4ab22e90a02 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:59.305911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce5b5b-ecea-4cfa-8119-e4ab22e90a02 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:59.306194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce5b5b-ecea-4cfa-8119-e4ab22e90a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:59.383699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-38ce5b5b-ecea-4cfa-8119-e4ab22e90a02 None None] MFA Rules not processed for user `572694e1f16040bea41fa0445501d01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:23:59.384937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38ce5b5b-ecea-4cfa-8119-e4ab22e90a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:59.404556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:59.458501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 720/1474] 10.222.0.30 () {58 vars in 1063 bytes} [Fri Sep 9 06:23:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:23:59.466075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:23:59.467700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:59.570150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1142-36aa-47f1-aa4d-7ab012d22d6b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:23:59.642676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:23:59.643277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:23:59.643559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:23:59.643833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:23:59.645464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:23:59.699132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:23:59.756179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:23:59.757653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380567-904a-4598-89d7-79d58e550702 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:23:59.775972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 755/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:02.004191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:02.004767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:02.004767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:02.006193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 721/1476] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:02.011526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a553-867c-4a20-87de-b0d876c058d9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:02.011954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a553-867c-4a20-87de-b0d876c058d9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:02.012108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a553-867c-4a20-87de-b0d876c058d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:02.077973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a102a553-867c-4a20-87de-b0d876c058d9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:02.079244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a102a553-867c-4a20-87de-b0d876c058d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:02.174711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 756/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:02.444879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:02.446339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:02.569465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413c45-04c7-4b5b-bf8a-4671c0194b71 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:02.618924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:02.662196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:02.662795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:02.663071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:02.663337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:02.663965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:02.665702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:24:02.665702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:24:02.665702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:24:02.666822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20055c6-ae74-40bb-9526-292521e43d0a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:02.686967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 722/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Sep 9 06:24:02 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:24:04.872550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:04.873106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:04.873106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:04.874410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 757/1479] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:04.879787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485df12-a87a-4723-a53c-779e976c321b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:04.880172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485df12-a87a-4723-a53c-779e976c321b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:04.880349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485df12-a87a-4723-a53c-779e976c321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:04.946154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d485df12-a87a-4723-a53c-779e976c321b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:04.947371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d485df12-a87a-4723-a53c-779e976c321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:05.044486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 723/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:05.338350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:05.340442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:05.350482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:05.485684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c799d-7d57-4eff-8320-0f63c551654c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:05.563706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:05.596812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:05.597412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:05.597690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:05.597963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:05.599554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:05.687811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:05.689428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6af7-f782-4e4e-9881-dbe11ddbdedd service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:05.707710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 758/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:08.077340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:08.077884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:08.077983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:08.079255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 724/1482] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:08.084721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2fe4-b39d-45bc-a5d0-af47abbf7aac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:08.085151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2fe4-b39d-45bc-a5d0-af47abbf7aac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:08.085307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e2fe4-b39d-45bc-a5d0-af47abbf7aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:08.152072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a30e2fe4-b39d-45bc-a5d0-af47abbf7aac None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:08.153302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a30e2fe4-b39d-45bc-a5d0-af47abbf7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:08.199451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:08.250182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 759/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:08.546081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:08.547691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:08.571196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:08.649456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5d049-3589-4c4b-921f-d5dfc9951a23 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:08.724222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:08.725261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:08.725547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:08.725817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:08.727463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:08.809621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:08.844107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:08.845570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef5b0-990a-4219-adf7-2b575bd21bb4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:08.863784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 725/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:11.037091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:11.037664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:11.037664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:11.038984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 760/1485] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:11.044907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793be93-015d-411d-8f94-9b2607f8ba47 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:11.045314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793be93-015d-411d-8f94-9b2607f8ba47 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:11.045499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793be93-015d-411d-8f94-9b2607f8ba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:11.119135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0793be93-015d-411d-8f94-9b2607f8ba47 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:11.120370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0793be93-015d-411d-8f94-9b2607f8ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:11.220298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 726/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:11.516774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:11.518347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:11.622377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1308ea8-fd03-49df-bf72-192147b4ac27 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:11.693330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:11.694896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:11.695478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:11.695941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:11.696391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:11.698365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:11.814224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:11.815553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed66c0-156a-4cdf-b8f4-e86b8f240537 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:11.833599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 761/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:14.068319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:14.068924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:14.068924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:14.070221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 727/1488] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:14.076255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d834-9536-439c-8c09-ce9664e76fe7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:14.076739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d834-9536-439c-8c09-ce9664e76fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:14.076838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d834-9536-439c-8c09-ce9664e76fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:14.141833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7e65d834-9536-439c-8c09-ce9664e76fe7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:14.143009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e65d834-9536-439c-8c09-ce9664e76fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:14.194963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:14.238400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 762/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:14.532852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:14.534416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:14.570010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:14.639023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b63c-74c9-40c3-a35b-a76b9d4ee6b4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:14.710500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:14.711100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:14.711381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:14.711650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:14.713336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:14.791546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:14.820472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:14.821951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee362bf-b99a-4e5d-a06e-7a0b9a48a9c1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:14.839941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 728/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:17.201718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:17.202158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:17.202281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:17.203588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 763/1491] 10.222.0.30 () {54 vars in 927 bytes} [Fri Sep 9 06:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:24:17.208787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d920e-8b63-40eb-be77-0d65b8c1ef72 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:17.209276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d920e-8b63-40eb-be77-0d65b8c1ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:17.209381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d920e-8b63-40eb-be77-0d65b8c1ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:17.274358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c31d920e-8b63-40eb-be77-0d65b8c1ef72 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:24:17.275554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c31d920e-8b63-40eb-be77-0d65b8c1ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:17.371366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 729/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Fri Sep 9 06:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:24:17.663674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:24:17.665260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:17.768426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dde79-8f04-4bf8-808e-4ab797b9f205 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:24:17.839691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:24:17.840289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:24:17.840591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:24:17.840856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:24:17.842427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:24:17.851058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:17.954145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:24:17.955477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12626d-2ac0-486b-9f4d-494646b92464 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:24:17.973531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 764/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:24:27.369288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=82 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:27.971259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=50 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:37.828655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:37.829280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:37.829280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:37.906556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:25:37.907785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.001355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 730/1494] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:25:38.009291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.009790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.009894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.085100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:25:38.086228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.183966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 765/1495] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:25:38.188796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.190013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.201812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd2079-1b3c-4668-aa27-d01d7e022007 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:38.262653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:38.296291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:38.296937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.297213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.297470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.299006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:25:38.299296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:38.300350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:38.300350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:25:38.300350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:25:38.301269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:38.312233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 731/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:25:38.320458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.329888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a135a-d8c8-4e67-b614-b8a58c086b87 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:38.390647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:38.424047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:38.424672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.424952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.425222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.425852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:38.427584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:38.427584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:25:38.427584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:25:38.428782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:38.484119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 766/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:25:38.488188 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.489757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.522948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bcd86-688e-4be7-b1c4-f7687385bff9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:38.614372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:38.614971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.615247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.615515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.616147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:38.617185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:38.617185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:25:38.617185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:25:38.618396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:38.660135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 732/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:25:38 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:25:38.664413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.665941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.731956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf736651-34db-491b-b236-2be3c0a62242 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:38.814899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:38.826402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:38.827005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.827314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.827587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.828247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:38.829292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:38.829292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:25:38.829292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:25:38.830169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:38.842422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 767/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:25:38.846527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.848088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:38.859726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc4fe-8b88-4a9d-b546-27c078b3bfca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:38.885751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:38.955516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:38.956149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:38.956430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:38.956774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:38.957484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:38.958519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:38.958519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:25:38.958519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:25:38.959404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f5a5e-e340-4147-9a86-2c7471d58ed3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:38.971664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 733/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:25:38.976116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:38.977706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.011556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69ff9-f506-4b40-a6d1-0471a3e33251 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:39.103822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:39.104471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.104806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.105078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] PATH_INFO: `/v3/projects/31bcdf438eb5459aac81521f37f34186/users/cec6e1240fba45fcbdfb9352f0423a7d/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.127491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bcdf438eb5459aac81521f37f34186, user_id=cec6e1240fba45fcbdfb9352f0423a7d, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:39.128508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:39.128508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:25:39.128508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:25:39.130458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70298d-c513-4ac2-9482-be073184317a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:39.153601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 768/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:25:38 2022] PUT /identity/v3/projects/31bcdf438eb5459aac81521f37f34186/users/cec6e1240fba45fcbdfb9352f0423a7d/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:25:39.166313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a004-7d02-4f16-b4f3-4e55e3d54266 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.166604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a004-7d02-4f16-b4f3-4e55e3d54266 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.166878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a004-7d02-4f16-b4f3-4e55e3d54266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.224002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ca36a004-7d02-4f16-b4f3-4e55e3d54266 None None] MFA Rules not processed for user `cec6e1240fba45fcbdfb9352f0423a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:25:39.225225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ca36a004-7d02-4f16-b4f3-4e55e3d54266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.301730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 734/1502] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:25:39.314873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.315159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.315432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.316786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 769/1503] 10.222.0.30 () {54 vars in 964 bytes} [Fri Sep 9 06:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:25:39.321565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1db89-5025-4567-af9c-c4f271addf91 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.321866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1db89-5025-4567-af9c-c4f271addf91 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.322118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1db89-5025-4567-af9c-c4f271addf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.353175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:39.396257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5bd1db89-5025-4567-af9c-c4f271addf91 None None] MFA Rules not processed for user `4fdc7998a54c420c920fc0e54b91b930`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:25:39.397467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5bd1db89-5025-4567-af9c-c4f271addf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.469620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 735/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Fri Sep 9 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:25:39.477591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:39.479754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.528550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:39.582014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68d80-609f-4087-8d0e-fed6ef1d08fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:39.654930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:39.655524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.655802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.656074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.657678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.754469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:39.755802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:39.759238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:39.773715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 770/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:25:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:25:39.818326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e49d1-8488-4c21-a83b-c72080fe0093 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:39.818612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e49d1-8488-4c21-a83b-c72080fe0093 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:39.818887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e49d1-8488-4c21-a83b-c72080fe0093 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:39.820138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 736/1506] 10.222.0.30 () {52 vars in 830 bytes} [Fri Sep 9 06:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:25:39.824163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:39.825397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:39.923638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff074-601a-4cae-9eda-16b466ce6c3c service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:40.014987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:40.015612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:40.015802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:40.016070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] PATH_INFO: `/v3/users/cec6e1240fba45fcbdfb9352f0423a7d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:40.028599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec6e1240fba45fcbdfb9352f0423a7d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:40.029599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:40.029599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:25:40.029599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:25:40.030793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:40.041271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:40.097241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec6e1240fba45fcbdfb9352f0423a7d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:40.121877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec6e1240fba45fcbdfb9352f0423a7d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:40.122456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec6e1240fba45fcbdfb9352f0423a7d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:40.136556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec6e1240fba45fcbdfb9352f0423a7d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:40.137049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec6e1240fba45fcbdfb9352f0423a7d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:40.151172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 771/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:25:39 2022] DELETE /identity/v3/users/cec6e1240fba45fcbdfb9352f0423a7d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:25:40.155559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:40.156033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:40.156142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:40.214640 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:25:40.215839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:40.288902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:40.301828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 737/1508] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:25:40.311897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:40.313225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:40.414736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572569c9-589e-45c5-a144-0452af7ac7b5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:40.469031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:40.489966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:40.490582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:40.490867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:40.491146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:40.492907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:40.602771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:40.604657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412dc2-07f4-4c12-8300-25e63cceb00d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:40.622588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 772/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:25:40.986331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:25:40.987588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:25:40.999350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb743-1370-4796-a868-3998598a6d3f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:25:41.096733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:25:41.097364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:25:41.097658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:25:41.097913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] PATH_INFO: `/v3/projects/31bcdf438eb5459aac81521f37f34186` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:25:41.110588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bcdf438eb5459aac81521f37f34186)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:25:41.111626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:25:41.111626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:25:41.111626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:25:41.112937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:25:41.170007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bcdf438eb5459aac81521f37f34186', 'request_id': 'req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:41.183728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bcdf438eb5459aac81521f37f34186', 'request_id': 'req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:41.189982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bcdf438eb5459aac81521f37f34186', 'request_id': 'req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:41.217091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] The token cache is being invalidate because project 31bcdf438eb5459aac81521f37f34186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:25:41.217386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:41.217817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c4e43b04-74c9-40ae-9bd9-2c2aa1731cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:25:41.219248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 738/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:25:40 2022] DELETE /identity/v3/projects/31bcdf438eb5459aac81521f37f34186 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:25:50.620338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=62 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:25:51.215030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:13.275578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:13.276161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:13.276161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:13.277514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:13.282403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b959a4-175b-4a55-b45d-cc624aeeaf53 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:13.282862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b959a4-175b-4a55-b45d-cc624aeeaf53 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:13.282970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b959a4-175b-4a55-b45d-cc624aeeaf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:13.365258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f2b959a4-175b-4a55-b45d-cc624aeeaf53 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:13.366457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f2b959a4-175b-4a55-b45d-cc624aeeaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:13.467009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:13.619985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:13.622115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:13.740126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80ff6-a66c-404b-8f02-0ab47c05fb23 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:13.745975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:13.746574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:13.746857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:13.747131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:13.755251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:13.756882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485ede-3893-4ad1-a0d9-078cc2220f7e service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:13.766855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 774/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:14.842521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c5f-eb3b-4d07-9ce3-be569374f044 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:14.843141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c5f-eb3b-4d07-9ce3-be569374f044 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:14.843141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02427c5f-eb3b-4d07-9ce3-be569374f044 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:14.844419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 740/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:14.850760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e049-7633-4ba6-8f96-f01bfb1c6f35 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:14.851215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e049-7633-4ba6-8f96-f01bfb1c6f35 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:14.852346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e049-7633-4ba6-8f96-f01bfb1c6f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:14.871904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5050e049-7633-4ba6-8f96-f01bfb1c6f35 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:14.873170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5050e049-7633-4ba6-8f96-f01bfb1c6f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:14.881295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 775/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:15.033221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427c5f-eb3b-4d07-9ce3-be569374f044 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:15.047401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02427c5f-eb3b-4d07-9ce3-be569374f044 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:15.052728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:15.053313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:15.053589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:15.053859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:15.061665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:15.063220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee6cf8-f9f0-47e8-9805-2e9665d8dabf service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:15.072843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 741/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:15.246823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bb76-f270-4096-81d4-e8dd4155f724 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:15.247105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bb76-f270-4096-81d4-e8dd4155f724 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:15.247375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bb76-f270-4096-81d4-e8dd4155f724 None None] PATH_INFO: `/v3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:15.248767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 776/1517] 10.222.0.23 () {54 vars in 925 bytes} [Fri Sep 9 06:27:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:27:15.255093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897fb3-aa7d-40f3-b8dd-28bb07c817b4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:15.255375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897fb3-aa7d-40f3-b8dd-28bb07c817b4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:15.255673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897fb3-aa7d-40f3-b8dd-28bb07c817b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:15.315779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dc897fb3-aa7d-40f3-b8dd-28bb07c817b4 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:15.316990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc897fb3-aa7d-40f3-b8dd-28bb07c817b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:15.333568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:15.387907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 742/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 9 06:27:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:18.942219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc867-5240-47f3-9d48-5beccfe9afa3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:18.942650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc867-5240-47f3-9d48-5beccfe9afa3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:18.942755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc867-5240-47f3-9d48-5beccfe9afa3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:18.944058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 777/1519] 10.222.0.30 () {54 vars in 961 bytes} [Fri Sep 9 06:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:18.948876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca49-88cf-4bde-8174-b8136dfec937 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:18.949337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca49-88cf-4bde-8174-b8136dfec937 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:18.949451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33ca49-88cf-4bde-8174-b8136dfec937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:18.969728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8c33ca49-88cf-4bde-8174-b8136dfec937 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:18.970905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8c33ca49-88cf-4bde-8174-b8136dfec937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:18.980091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 743/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Fri Sep 9 06:27:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:18.987449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc867-5240-47f3-9d48-5beccfe9afa3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:19.000423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc867-5240-47f3-9d48-5beccfe9afa3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:19.005329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:19.005913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:19.006190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:19.006461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:19.015160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:19.016951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d56c82-89f9-47d2-adba-638af05cf846 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:19.026717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 778/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:26.516538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f909a-7156-46d1-8153-34ac39bd38bd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:26.517183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f909a-7156-46d1-8153-34ac39bd38bd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:26.517183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f909a-7156-46d1-8153-34ac39bd38bd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:26.518483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:26.524620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268113c-af29-4db4-ac7e-662961ebd01c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:26.525107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268113c-af29-4db4-ac7e-662961ebd01c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:26.525217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268113c-af29-4db4-ac7e-662961ebd01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:26.543952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d268113c-af29-4db4-ac7e-662961ebd01c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:26.545159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d268113c-af29-4db4-ac7e-662961ebd01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:26.552834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:26.707101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f909a-7156-46d1-8153-34ac39bd38bd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:26.724294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f909a-7156-46d1-8153-34ac39bd38bd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:26.730747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:26.731348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:26.731633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:26.731909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:26.739850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:26.741471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaccae7-722a-4f93-ade0-fa1835b82a82 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:26.750811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 745/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:27.820629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc79c-9639-44b2-9efa-f040141ca500 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:27.821182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc79c-9639-44b2-9efa-f040141ca500 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:27.821182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc79c-9639-44b2-9efa-f040141ca500 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:27.822549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 06:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:27.828924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed00ca-fe53-4d5b-9e5d-39b26c59fdf5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:27.829331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed00ca-fe53-4d5b-9e5d-39b26c59fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:27.829481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed00ca-fe53-4d5b-9e5d-39b26c59fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:27.848473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c6ed00ca-fe53-4d5b-9e5d-39b26c59fdf5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:27.849698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c6ed00ca-fe53-4d5b-9e5d-39b26c59fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:27.858118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 06:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:28.010988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc79c-9639-44b2-9efa-f040141ca500 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:28.025200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc79c-9639-44b2-9efa-f040141ca500 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:28.030474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:28.031057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:28.031337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:28.031607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:28.039330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:28.041235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4382b-9ca4-492c-b2a4-13c2d85a54fe service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:28.050390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 781/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:32.121495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:32.122081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:32.122081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:32.123409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:32.128496 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b3aa-67b3-403f-82be-12a1bebedff2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:32.128934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b3aa-67b3-403f-82be-12a1bebedff2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:32.129078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b3aa-67b3-403f-82be-12a1bebedff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:32.149004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1640b3aa-67b3-403f-82be-12a1bebedff2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:32.150178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1640b3aa-67b3-403f-82be-12a1bebedff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:32.157958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:32.441956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:32.443676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:32.523349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62224a-2b8a-4a0f-b857-f76277eaff5b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:32.527061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:32.527666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:32.527946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:32.528249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:32.537108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:32.538585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd65e5-b583-4391-8864-0a25ad554a94 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:32.550797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 748/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:34.713737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378824-7c1b-4c13-adaa-5246c2d7c725 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:34.714304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378824-7c1b-4c13-adaa-5246c2d7c725 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:34.714304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378824-7c1b-4c13-adaa-5246c2d7c725 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:34.715621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:34.721035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63354d-d8cb-4828-bbc8-3cf158265eba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:34.721484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63354d-d8cb-4828-bbc8-3cf158265eba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:34.721594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63354d-d8cb-4828-bbc8-3cf158265eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:34.741121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cb63354d-d8cb-4828-bbc8-3cf158265eba None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:34.742830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cb63354d-d8cb-4828-bbc8-3cf158265eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:34.750914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:35.041395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3378824-7c1b-4c13-adaa-5246c2d7c725 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:35.052291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3378824-7c1b-4c13-adaa-5246c2d7c725 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:35.055862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:35.056456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:35.056774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:35.057050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:35.065760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:35.067163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d163b-2ebc-444c-b548-65a6c9fee40a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:35.076296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 784/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:38.768007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:38.768557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:38.768557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:38.769926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:38.776426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667aeae-e49b-4351-ad81-45f3ec8d5d85 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:38.777136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667aeae-e49b-4351-ad81-45f3ec8d5d85 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:38.777136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667aeae-e49b-4351-ad81-45f3ec8d5d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:38.797719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e667aeae-e49b-4351-ad81-45f3ec8d5d85 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:38.798910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e667aeae-e49b-4351-ad81-45f3ec8d5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:38.806631 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:39.110906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:39.112631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:39.176417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:39.190995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e237f0-baeb-45a3-b4e2-6a77e6a23514 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:39.195113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:39.195723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:39.196003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:39.196276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:39.205157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:39.206579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b2d05-8fa8-4740-b91b-b4875fd652ef service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:39.216413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 751/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:41.362736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:41.363294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:41.363294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:41.364653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 06:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:27:41.370619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b921-b6b0-42de-816f-093f3370e251 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:41.371073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b921-b6b0-42de-816f-093f3370e251 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:41.371187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b921-b6b0-42de-816f-093f3370e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:41.390259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bd92b921-b6b0-42de-816f-093f3370e251 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:27:41.391440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bd92b921-b6b0-42de-816f-093f3370e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:41.400120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 06:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:27:41.700197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:27:41.701930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:27:41.709399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:41.716114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ffe7e-ad04-448f-ad79-4dad0ed124a6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:27:41.719626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:27:41.720219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:27:41.720510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:27:41.720822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:27:41.730360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:27:41.731777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b676a3-beba-4041-82bd-5d932b56f68e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:27:41.741069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 787/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:27:51.385458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=11 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:51.736904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:09.738135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:09.738785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:09.738785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:09.761848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:09.763058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:09.777074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 753/1540] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:09.786589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:09.788178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:09.788178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:09.815520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:09.816763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:09.832354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 788/1541] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:09.837123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:09.850523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44afe8-5f09-4bbb-9645-e210992f2d9d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:09.860929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:09.861567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:09.861854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:09.862132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:09.862794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:09.863103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:09.864765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:09.883962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 754/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:09.892062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:09.906216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d3447-ef83-475e-b6cd-42f506b2b8e4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:09.916866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:09.917494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:09.917776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:09.918046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:09.918702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:09.920619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:09.976758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 789/1543] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:09 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:09.981346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:09.996723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6650be-288e-42b8-a9d6-3e359152d7a1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.081480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.082132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.082436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.082715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.083392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.086309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.117521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 755/1544] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:09 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:10.121272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.140094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e796-30be-4aa3-9d8c-b86b2f606a16 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.157423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.158060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.158338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.158609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.159267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.160921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.172875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 790/1545] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:10.179978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.202236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea8d5-c4d8-4d00-975c-47cfdb9f4515 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.215191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.215836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.216177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.216477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.217213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.218857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c1c61-0c6a-4b2c-acb2-19e2098986d1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.236856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 756/1546] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:10.241488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.259554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20060792-f90e-4594-96fd-5e3a0ec2bf97 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.273400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.274304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.274594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.274874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] PATH_INFO: `/v3/projects/4d59b785f4444662a1befc4bc9db25a6/users/27e3cd69d63044da8baf4c15830ec489/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.302292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d59b785f4444662a1befc4bc9db25a6, user_id=27e3cd69d63044da8baf4c15830ec489, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.305226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d583f-f92b-4fe0-a5de-6c2817e09024 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.331041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 791/1547] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:10 2022] PUT /identity/v3/projects/4d59b785f4444662a1befc4bc9db25a6/users/27e3cd69d63044da8baf4c15830ec489/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:10.368097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086fe4-2573-424e-99a7-4a75b47ac582 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.368492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086fe4-2573-424e-99a7-4a75b47ac582 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.369479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086fe4-2573-424e-99a7-4a75b47ac582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.390002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe830c-b6db-4f8a-82ab-bf443c21610c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.390002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe830c-b6db-4f8a-82ab-bf443c21610c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.390303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe830c-b6db-4f8a-82ab-bf443c21610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.430304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e9fe830c-b6db-4f8a-82ab-bf443c21610c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.431683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e9fe830c-b6db-4f8a-82ab-bf443c21610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.432864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-17086fe4-2573-424e-99a7-4a75b47ac582 None None] MFA Rules not processed for user `27e3cd69d63044da8baf4c15830ec489`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.434080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-17086fe4-2573-424e-99a7-4a75b47ac582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.520226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 792/1548] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:10.521555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec693-d0c3-4ca9-97e7-6461c8f3f994 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.521946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec693-d0c3-4ca9-97e7-6461c8f3f994 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.523188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec693-d0c3-4ca9-97e7-6461c8f3f994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.563322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f4ec693-d0c3-4ca9-97e7-6461c8f3f994 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.564550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f4ec693-d0c3-4ca9-97e7-6461c8f3f994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.574251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 757/1549] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.575339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9d88-64e1-4aed-8f8e-6769cb0267e9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.575627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9d88-64e1-4aed-8f8e-6769cb0267e9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.575911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a9d88-64e1-4aed-8f8e-6769cb0267e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.591477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 793/1550] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.592760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758a96-3ded-4739-ad78-89fd977ed3e7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.593057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758a96-3ded-4739-ad78-89fd977ed3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.594537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758a96-3ded-4739-ad78-89fd977ed3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.638469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-902a9d88-64e1-4aed-8f8e-6769cb0267e9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.638469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-902a9d88-64e1-4aed-8f8e-6769cb0267e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.643602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-65758a96-3ded-4739-ad78-89fd977ed3e7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.645462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-65758a96-3ded-4739-ad78-89fd977ed3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.659960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 758/1551] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.661853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a24-cca5-45b5-8a97-038bb9d8f103 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.662949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a24-cca5-45b5-8a97-038bb9d8f103 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.663518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a24-cca5-45b5-8a97-038bb9d8f103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.667911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 794/1552] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.669728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926473-6f5a-4228-b939-9a0c53bf4910 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.669728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926473-6f5a-4228-b939-9a0c53bf4910 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.669728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926473-6f5a-4228-b939-9a0c53bf4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.690813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-46ad6a24-cca5-45b5-8a97-038bb9d8f103 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.692015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-46ad6a24-cca5-45b5-8a97-038bb9d8f103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.695751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-87926473-6f5a-4228-b939-9a0c53bf4910 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.697207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-87926473-6f5a-4228-b939-9a0c53bf4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.700650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 759/1553] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.702139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db63f-a792-485c-8ab9-db2d22704cca None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.702678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db63f-a792-485c-8ab9-db2d22704cca None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.703125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db63f-a792-485c-8ab9-db2d22704cca None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.704527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 760/1554] 10.222.0.30 () {54 vars in 962 bytes} [Fri Sep 9 06:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:10.705843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049a0-8819-40e0-a140-5b57bc6d1852 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.706346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049a0-8819-40e0-a140-5b57bc6d1852 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.706797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049a0-8819-40e0-a140-5b57bc6d1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.713433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 795/1555] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.715066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0da33-6c97-4122-81ce-a4341a2c6cb5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.715827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0da33-6c97-4122-81ce-a4341a2c6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.716422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0da33-6c97-4122-81ce-a4341a2c6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.728950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bf4049a0-8819-40e0-a140-5b57bc6d1852 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.730147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bf4049a0-8819-40e0-a140-5b57bc6d1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.737083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-66c0da33-6c97-4122-81ce-a4341a2c6cb5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.738267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-66c0da33-6c97-4122-81ce-a4341a2c6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.738728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 761/1556] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.739997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.740315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.740670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.751386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 796/1557] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.752750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d29b-c4e3-4fcd-8bc9-f5fd5f3ac29a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.753054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d29b-c4e3-4fcd-8bc9-f5fd5f3ac29a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.753334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897d29b-c4e3-4fcd-8bc9-f5fd5f3ac29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.762311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.763597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.772710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 762/1558] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.773436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.774654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f897d29b-c4e3-4fcd-8bc9-f5fd5f3ac29a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.775828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f897d29b-c4e3-4fcd-8bc9-f5fd5f3ac29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.782736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b2187-4a5d-40e1-8449-eb95b373738e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.786723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 797/1559] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.786723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.786723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.786723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.791240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.791845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.792130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.792406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.793094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:10.793407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.795022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23aa7-7fe5-4392-8441-15283fdba0a1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.807922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 763/1560] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:10.809235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.809520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.809794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.828986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.830184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.836050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.837242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.838602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 764/1561] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.839374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.843891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:10.849411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a95a-2e72-4204-99b8-b285350cef7a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.855896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.856493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.856821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.857075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.857714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:10.858015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.859638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28e4a-4d98-4925-bdb1-98a0ade66381 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.871278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 765/1562] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:10.872695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84047c9-aab7-4643-baa1-9f2d45f24b9a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.872983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84047c9-aab7-4643-baa1-9f2d45f24b9a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.873257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84047c9-aab7-4643-baa1-9f2d45f24b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.890646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:10.892177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e84047c9-aab7-4643-baa1-9f2d45f24b9a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.893551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e84047c9-aab7-4643-baa1-9f2d45f24b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.902654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 766/1563] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.903784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.904070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.904341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.923369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.924541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.927373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 798/1564] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.929494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.933249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 767/1565] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:10.933939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.943052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201710-6a52-4690-8c9d-ad50bdb07551 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.943692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e760-9b76-449a-a6c2-dea3622756fd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.947724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.948300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.948446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.948592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.948889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.949007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.949293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.949524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:10.949631 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.949827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.950242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:10.950537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.951412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.951548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:10.951548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:29:10.951548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:29:10.952487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2159-44cb-494b-b1f1-134959ec42e1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.963430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 768/1566] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:10.964198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:10.972079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 799/1567] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:10.972079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.972079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.972079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.974360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed92d-1453-40d2-a3fa-4296020f2a6f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:10.979470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:10.980162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:10.980462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:10.980797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:10.981496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:10.982584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:10.982584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:29:10.982584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:29:10.983755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:10.990327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:10.992051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:10.999859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 800/1568] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:11.000821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.010568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9c0b9-15e0-4f22-9068-35d09f24fb4c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.017791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 769/1569] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.017959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.018088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.018194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.018194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.018194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.018194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.018879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.049460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 801/1570] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.049460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.081585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea0cf-f839-4158-be9e-734e1d79b0ec admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.124491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62416-2b13-48a7-a615-08f32c0e349e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.130439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.131051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.131336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.131609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.141466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.142093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.142358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.142627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.143290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:11.143739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.145380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.156575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 770/1571] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:11.164359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.167361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178dbf2-ee1b-4729-8ef5-9dcdb418baff admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.171913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.172489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.172861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.173138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.173758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:11.174056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.175620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.189263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 771/1572] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:11.190022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.199393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa90a-c636-49e8-bbef-facfd196c433 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.203969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.204544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.204857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.205128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.205750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.207643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.207789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.209541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.219183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 802/1573] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:11.219974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.231019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c666fe8-13e1-4159-94d6-74038db8bd73 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.235815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.236409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.236725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.236996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.237619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.238362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 772/1574] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.239293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.243336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.249466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:11.272512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 803/1575] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.273996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.283835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:11.312018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413708a0-8b60-4bfc-817a-7a059f27cdcd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.344547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d143d-1460-469c-9ba3-0316daeaad63 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.349378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.350618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.350993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.351363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.352358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.353506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:11.353506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:29:11.353506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:29:11.354963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.371944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.372576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.372873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.373147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.373783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:11.374201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.375661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.377649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 804/1576] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.378436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.389877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef2708-509b-4ecb-af33-4c15a1ead70d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.393004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 773/1577] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:11.395061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.395724 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.396068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.396403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.397871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.399954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.401305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.411394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f9f1c-53fd-47a0-9447-84ca11bbde9c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.416609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.417284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.417625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.417931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.418595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.420483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.426905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 805/1578] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.426905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.436842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87ed9-af52-49e9-84f6-992bf9bfeb34 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.442616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.443218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.445545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.445848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.446633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.449201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.455662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 774/1579] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.455662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.483031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 806/1580] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.483031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.525372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e935-2a1f-458e-9c19-6e34d38e4a3b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.544839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd7fc3-f897-41ff-9193-fca9341479ee admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.549382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.550401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.550401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.550626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.551174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.553669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.557265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:11.577773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 807/1581] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.578526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.588821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990364d-8377-4323-94cc-4af4b39fa16d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.590704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.591409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.591692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.591967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.592627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.593430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.594014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.594291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.594540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.594660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.595215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.596803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.608720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 808/1582] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.609682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.617196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 775/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.618017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.624160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54404-f03b-4e80-be7b-1a28204edbb0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.627627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200402-4a8b-424c-af57-f563954609f3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.628832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.629420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.629697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.629969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.630588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.632355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.632511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593fd8-2dc1-4c72-b2fa-ef9879c299ef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.633045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.633327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.633629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.634381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.635943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.646110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 776/1584] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.647644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.658326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b87850-45ee-43e3-8347-49263a40820c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.663416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 809/1585] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.663416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f220-3ee1-48b0-ba31-082719162da0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.663416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f220-3ee1-48b0-ba31-082719162da0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.663416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f220-3ee1-48b0-ba31-082719162da0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.663416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 810/1586] 10.222.0.30 () {54 vars in 912 bytes} [Fri Sep 9 06:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:11.664013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f220-3ee1-48b0-ba31-082719162da0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.679076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:11.719598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.720208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.720491 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.720797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.721426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.723403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.736865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f220-3ee1-48b0-ba31-082719162da0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.742216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.742878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.743171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.743451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.744079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.746090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.750717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 777/1587] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.750717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.764824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f312b11-3548-406d-8ab3-b131a3b3cad4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.772144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 811/1588] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.772310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.772430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.772542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.772542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.772542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.772542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.773698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.782492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-94b2-43b2-9e1c-9e5cba49e535 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.789035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 778/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.789035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.789261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.789261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.789261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.789261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.789932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.791385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.796961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335d287-0df0-40cf-affd-e9e77e6fae0e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.801471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 812/1590] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.801878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.802586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.802703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.803519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.803770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.804427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.806464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.812818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031389-17df-40b6-9ec3-046439d2d910 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.816501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 779/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.817436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.817575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.818019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.818306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.818612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.819245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.820842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19ebdf-009d-48ab-8060-6aa9bca1a098 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.829691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a49a7-ba2d-401c-949b-aaf69ae6e1df admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.831472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 813/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.832752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.832984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.833259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.834345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.834917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.835197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.835469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.836092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.838010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.853032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:11.854272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:11.860032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 780/1593] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:11.861023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.872439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6025106-8552-4978-9f43-a9d36342a160 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.877393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.877989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.878272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.878549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.879186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.881460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.895682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 781/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.895682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.903657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8227ce0-66a6-47c2-ac00-c7aaa5a32d74 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.908363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.908978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.909266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.909542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.910220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.911907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.922346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 782/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.923186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.928828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 814/1596] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:11.930290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.933388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a698-5516-409b-af09-4bc224d7155f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.939042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.939643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.939926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.940201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.940865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.941056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aea21f-20f6-4703-80f5-c01b637c9102 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.942452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.946431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.947137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.947422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.947695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] PATH_INFO: `/v3/projects/3e82a41b1d0d49e487e050a4192e7d9b/users/d9430b8d3d4b4228884a41b004e6891b/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.953530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 783/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.957249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.963588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e82a41b1d0d49e487e050a4192e7d9b, user_id=d9430b8d3d4b4228884a41b004e6891b, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.966265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.966699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e6d99-7e7e-4004-97fc-608674bbfd6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:11.971634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:11.972374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:11.972823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:11.973244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:11.974087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:11.976655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:11.982553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 815/1598] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:11 2022] PUT /identity/v3/projects/3e82a41b1d0d49e487e050a4192e7d9b/users/d9430b8d3d4b4228884a41b004e6891b/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:11.983332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:11.989753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 784/1599] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:11.990946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.001785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcce12-0ca1-45f9-83ea-cf68db45e9cf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.016380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.035118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.049927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37d45-c40f-4ee3-84d9-1072ba86fc94 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.055370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.056032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.056313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.056616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] PATH_INFO: `/v3/projects/7d219d62aac64834adc56e6c14322a9e/users/f856533ec21848db82c0fef655013f4d/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.063508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.064147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.064429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.064731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.065371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.066968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.071119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d219d62aac64834adc56e6c14322a9e, user_id=f856533ec21848db82c0fef655013f4d, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.073766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.076997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 785/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:12.077803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.087510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb19187-e0b1-4a8a-9050-86e9f5bb2457 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.088832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 816/1601] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:11 2022] PUT /identity/v3/projects/7d219d62aac64834adc56e6c14322a9e/users/f856533ec21848db82c0fef655013f4d/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.089633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.148578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.148578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.148578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.149011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.149296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.150956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.153340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f50b-23f3-4676-b71c-91c360e14e28 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.158602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.159198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.159475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.159744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.160408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.162084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.163210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 786/1602] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:12.164277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.175357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 817/1603] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:12.175357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.182876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6afe-d257-45cf-93b3-2c38914aed49 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.189067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.189756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.190039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.190323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] PATH_INFO: `/v3/projects/3f834bc2033f4d89a9a54c7954096357/users/3736d59b92ef4feb910f6d39d7ac804c/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.207265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f834bc2033f4d89a9a54c7954096357, user_id=3736d59b92ef4feb910f6d39d7ac804c, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.210520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.224356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 818/1604] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:12 2022] PUT /identity/v3/projects/3f834bc2033f4d89a9a54c7954096357/users/3736d59b92ef4feb910f6d39d7ac804c/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.225109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.232969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dabcb8-ef48-4cd0-a356-0c1e28f26266 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.282216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.282913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.283195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.283472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.287599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212850-8816-4009-9f5d-9506966daf02 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.292277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.292977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.293264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.293566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] PATH_INFO: `/v3/projects/756f58f3dc55432d9e817bbb3483de25/users/eb98149493ce4a73990d9f3737c2540a/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.302122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.308318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f58f3dc55432d9e817bbb3483de25, user_id=eb98149493ce4a73990d9f3737c2540a, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.310991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec4482-8445-433e-8d22-8e17158a8688 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.324911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 819/1605] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:12 2022] PUT /identity/v3/projects/756f58f3dc55432d9e817bbb3483de25/users/eb98149493ce4a73990d9f3737c2540a/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.336705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc458d4-f7c9-48b4-8dae-b8abe56535a6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.336999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc458d4-f7c9-48b4-8dae-b8abe56535a6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.337276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc458d4-f7c9-48b4-8dae-b8abe56535a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.356017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.357428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.365170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3bc458d4-f7c9-48b4-8dae-b8abe56535a6 None None] MFA Rules not processed for user `d9430b8d3d4b4228884a41b004e6891b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.366908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3bc458d4-f7c9-48b4-8dae-b8abe56535a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.368652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 787/1606] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:12.369441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.379452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929086e-f77c-4be8-96f9-f65f553e53b9 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.381660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.445617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.446194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.446569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.446860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.447506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.449181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.449878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 820/1607] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.451008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.451296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.451568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.467174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 788/1608] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:12.468448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.474368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.476127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.482857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd27c-785f-4dae-a7e6-b8d4e0e3ef76 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.484689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 821/1609] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.488091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.493874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.494949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.495329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.495699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] PATH_INFO: `/v3/projects/3d7a54c72fa44766923e5138caca22ee/users/7faaad3f75da43a8b51b078306a50319/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.497434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53794b-564f-40dd-9a4e-fa9f06d032fa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.503718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.504393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.504692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.504969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] PATH_INFO: `/v3/projects/b01373df02f04ac69cffa1999656a836/users/f920842016e14eb8b43ba27912116e17/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.512668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7a54c72fa44766923e5138caca22ee, user_id=7faaad3f75da43a8b51b078306a50319, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.513830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:12.513830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:29:12.513830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:29:12.516000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897db2-7d77-49a7-8c79-78786802576e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.525965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01373df02f04ac69cffa1999656a836, user_id=f920842016e14eb8b43ba27912116e17, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.529088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e916-4af4-4189-84ed-989ed7ff70ba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.531431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 789/1610] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:12 2022] PUT /identity/v3/projects/3d7a54c72fa44766923e5138caca22ee/users/7faaad3f75da43a8b51b078306a50319/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.533007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.533445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.535398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.545932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 822/1611] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:12 2022] PUT /identity/v3/projects/b01373df02f04ac69cffa1999656a836/users/f920842016e14eb8b43ba27912116e17/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.550522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.550806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.551081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.554563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.555869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.581952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] MFA Rules not processed for user `eb98149493ce4a73990d9f3737c2540a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.584186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.621235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 790/1612] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.622218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.647000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.680703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 823/1613] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.681560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.693028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40749bf-c833-4ab5-a474-754114fcd02a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.696876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e1d3c-24e1-4449-968b-bd182748c91a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.700007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.700783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.700915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.701214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.701554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] PATH_INFO: `/v3/projects/3089bccb17e0401ebc27a3cbbc752b02/users/f534b7b5831d4dfc9da5641553c9f635/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.701654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.701983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.702363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.717143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3089bccb17e0401ebc27a3cbbc752b02, user_id=f534b7b5831d4dfc9da5641553c9f635, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.719877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.735436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 824/1614] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:12 2022] PUT /identity/v3/projects/3089bccb17e0401ebc27a3cbbc752b02/users/f534b7b5831d4dfc9da5641553c9f635/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:12.736524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.738207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.772559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.774040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2aceb-e881-452d-87e2-5586403f0295 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.784522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 791/1615] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:12.787833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002edb-0679-4b32-8776-7207f368d584 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.788151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002edb-0679-4b32-8776-7207f368d584 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.788428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002edb-0679-4b32-8776-7207f368d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.811179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4d002edb-0679-4b32-8776-7207f368d584 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.812485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4d002edb-0679-4b32-8776-7207f368d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.814317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694aae-3a42-4250-9aee-13eb738a6110 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.820233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.821188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.821459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.821801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.827184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:12.910849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 792/1616] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.912129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.912965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.913241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.922956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.924398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.944187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:12.945408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:12.957820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 825/1617] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:12.957820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.961391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3357e-a562-4f97-9fb7-086349452522 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.964990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 793/1618] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:12.966100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:12.969076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.969700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.969979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.970249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.981051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4f047-03e8-4f1a-bd9c-f31bad72ffb5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:12.981679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.983233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb896eb-61d3-4da5-9520-89c635406f04 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.987259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:12.988240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.988772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.989958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:12.991243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:12.993299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:12.996010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 826/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:12.998085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:12.999001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:12.999542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.027529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:13.029707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:13.045903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 827/1620] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:13.052309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.071117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 794/1621] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:12 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:13.072274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.077303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7ba73-faa7-4d80-a32e-1cd48af146af None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.203816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:13.215558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31becb58-010b-40ea-8a7e-989a37fcb213 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.219557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.220181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.220463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.222932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.226248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.230209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.231040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.231834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.368261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.371300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.387377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.388909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.397763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 828/1622] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:13.398702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.399830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 795/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:13.400698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.409861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7387490-7d72-4b73-8115-13010fb23da8 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.415050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.415670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.416006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.416285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.420338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d79d-194f-4175-85e3-b472f5e0b8ba service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.428325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.431020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c16e4-e88c-4c5a-a1ee-2ec6222caec9 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.435204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.435878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.436212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.436424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.437275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.440818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.464097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 796/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:13.466585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d182fc-5c4a-44b4-aab2-ac908828faf1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.466876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d182fc-5c4a-44b4-aab2-ac908828faf1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.467147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d182fc-5c4a-44b4-aab2-ac908828faf1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.477349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 797/1625] 10.222.0.30 () {54 vars in 962 bytes} [Fri Sep 9 06:29:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:13.478812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344214-9caa-4303-8b96-25fadaa2c2ba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.480224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344214-9caa-4303-8b96-25fadaa2c2ba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.480505 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344214-9caa-4303-8b96-25fadaa2c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.515394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 829/1626] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:13 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:13.516115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.527092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-16344214-9caa-4303-8b96-25fadaa2c2ba None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:13.528824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-16344214-9caa-4303-8b96-25fadaa2c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:13.537734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247b8-36f4-4884-8ee2-c7351ea37e8d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.548704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.549326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.549619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.549883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.550641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.552474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.580321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 830/1627] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:13.591751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.597944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:13.620590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d604e-db75-4c02-b7d3-adae80688408 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.626692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.627647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.628150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.628662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] PATH_INFO: `/v3/projects/f6802c66c47f46918724cad633349ffd/users/7e9785d18e684182bb33f62c2dc1c825/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.648498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6802c66c47f46918724cad633349ffd, user_id=7e9785d18e684182bb33f62c2dc1c825, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.653689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.690348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 831/1628] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:13 2022] PUT /identity/v3/projects/f6802c66c47f46918724cad633349ffd/users/7e9785d18e684182bb33f62c2dc1c825/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:13.691362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.727685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 798/1629] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Sep 9 06:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:13.735600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858bd1e-3fb9-4fe4-a4c5-d9ba5816e216 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.735980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858bd1e-3fb9-4fe4-a4c5-d9ba5816e216 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.737533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858bd1e-3fb9-4fe4-a4c5-d9ba5816e216 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.742562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 799/1630] 10.222.0.30 () {54 vars in 912 bytes} [Fri Sep 9 06:29:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:13.749304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.750916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.751714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.810804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:13.812350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:13.857528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835530b-f177-4dab-a496-bb59fe524a55 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.864116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.864116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.864116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.864498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.865797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.868421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.884263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 832/1631] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:13.885266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.899692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67719a7-3d9d-4fe1-b5d7-b62b2b6c33f7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:13.908061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:13.908926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.909228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.909713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] PATH_INFO: `/v3/projects/f6802c66c47f46918724cad633349ffd/users/7e9785d18e684182bb33f62c2dc1c825/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.912669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6802c66c47f46918724cad633349ffd, user_id=7e9785d18e684182bb33f62c2dc1c825, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:13.916061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15056e-3b98-45eb-84ce-d94b14c9c45c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:13.923918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 800/1632] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:13.930812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 833/1633] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:13 2022] PUT /identity/v3/projects/f6802c66c47f46918724cad633349ffd/users/7e9785d18e684182bb33f62c2dc1c825/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:13.938323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:13.942354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:13.942717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:13.943068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:13.949942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:13.996152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] MFA Rules not processed for user `7e9785d18e684182bb33f62c2dc1c825`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:13.998090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:14.034776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aab4db-c7c8-4f41-a850-e0684ad96f78 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:14.157323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:14.158010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:14.158290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:14.158571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:14.206429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 834/1634] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:14.229405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:14.268840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496704-1c3a-4e7f-bbc4-91e63a2b0d15 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:14.276136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:14.276906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:14.277195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:14.278368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:14.295360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:14.297880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:14.316997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 835/1635] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:14 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:14.326342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:14.327828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea193-d150-4d86-8919-cc1b979cf2dd service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:14.351695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 801/1636] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:14.546084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:14.635715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:14.696799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85043-0e0f-45d1-a188-b3587a1723d3 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:14.716579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:14.717456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:14.717832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:14.718169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] PATH_INFO: `/v3/users/eb98149493ce4a73990d9f3737c2540a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:14.719407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb98149493ce4a73990d9f3737c2540a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:14.721643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:14.818874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb98149493ce4a73990d9f3737c2540a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:14.849324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb98149493ce4a73990d9f3737c2540a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:14.853192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb98149493ce4a73990d9f3737c2540a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:14.876002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb98149493ce4a73990d9f3737c2540a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:14.877165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb98149493ce4a73990d9f3737c2540a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:14.913005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 836/1637] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:14 2022] DELETE /identity/v3/users/eb98149493ce4a73990d9f3737c2540a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:14.918820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:14.919292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:14.919458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:14.945707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:14.947265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:15.039549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 802/1638] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:15.230446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:15.233366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:15.379693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b482c5-63ef-4286-8bc4-ac9aabcadbd4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:15.384290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:15.384649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:15.385078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:15.385431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:15.423121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:15.425546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:15.443898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 837/1639] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:16.472345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:16.477405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:16.499152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:16.531243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd9386-12de-4920-804d-13392045b1cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:16.551058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:16.554714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:16.555660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:16.557392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] PATH_INFO: `/v3/projects/756f58f3dc55432d9e817bbb3483de25` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:16.563286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756f58f3dc55432d9e817bbb3483de25)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:16.573447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:16.747888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756f58f3dc55432d9e817bbb3483de25', 'request_id': 'req-1376d899-566a-48be-9fcb-6939b3f41a18'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:16.757874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756f58f3dc55432d9e817bbb3483de25', 'request_id': 'req-1376d899-566a-48be-9fcb-6939b3f41a18'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:16.801019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756f58f3dc55432d9e817bbb3483de25', 'request_id': 'req-1376d899-566a-48be-9fcb-6939b3f41a18'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:16.853209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] The token cache is being invalidate because project 756f58f3dc55432d9e817bbb3483de25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:16.853890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:16.855026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1376d899-566a-48be-9fcb-6939b3f41a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:16.858735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 803/1640] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:16 2022] DELETE /identity/v3/projects/756f58f3dc55432d9e817bbb3483de25 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:16.862911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:16.876967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9fa17-aeda-44bd-a044-4e7f7ec04961 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:17.018638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:17.049550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:17.050209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:17.050495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:17.050771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] PATH_INFO: `/v3/users/7e9785d18e684182bb33f62c2dc1c825` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:17.053634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9785d18e684182bb33f62c2dc1c825)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:17.057463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:17.209172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9785d18e684182bb33f62c2dc1c825'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:17.266455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9785d18e684182bb33f62c2dc1c825'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:17.269350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9785d18e684182bb33f62c2dc1c825'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:17.300080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9785d18e684182bb33f62c2dc1c825'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:17.301809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9785d18e684182bb33f62c2dc1c825'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:17.331317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:17.332299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:17.334542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:17.344128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 838/1641] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:16 2022] DELETE /identity/v3/users/7e9785d18e684182bb33f62c2dc1c825 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:17.478247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] MFA Rules not processed for user `7faaad3f75da43a8b51b078306a50319`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:17.483402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:17.715671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 804/1642] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:17.720425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:17.722182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:17.815201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2d14-9b68-438e-9675-59bf7c327d26 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:17.824312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:17.833658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:17.834258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:17.834768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:17.835903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:17.838338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:17.883891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:17.893355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 839/1643] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:17 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:17.898783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa671-aef1-4707-9e2b-362c638d061a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:17.977535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:17.978327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:17.978879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:17.979529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:17.980918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:17.983238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:18.019545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 805/1644] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:17 2022] POST /identity/v3/users => generated 309 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:18.023707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:18.035396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824839-580b-4b38-8a30-e50c2ea696ed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:18.040982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:18.041615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:18.041899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:18.042176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:18.042837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:18.044501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:18.062736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:18.071157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 840/1645] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:18.079015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a62cb-4d87-4a2a-b83c-15975caee242 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:18.089013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:18.090256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:18.090764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:18.091225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] PATH_INFO: `/v3/projects/047dfcc3801d4d38a69da358d438b77e/users/f40ffe7d37af49f1bd0dc370aee91b61/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:18.096886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:18.121396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=047dfcc3801d4d38a69da358d438b77e, user_id=f40ffe7d37af49f1bd0dc370aee91b61, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:18.124765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:18.153154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 806/1646] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:18 2022] PUT /identity/v3/projects/047dfcc3801d4d38a69da358d438b77e/users/f40ffe7d37af49f1bd0dc370aee91b61/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:18.157400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:18.171016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efae2b-04c9-493b-b720-e836f265431a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:18.305572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:18.332164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:18.332826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:18.333111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:18.333389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:18.334573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:18.339799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:18.359568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:18.360283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 841/1647] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:18.371923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398e5a7-0f8a-4c0d-8873-df13ab05b18f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:18.388437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:18.389417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:18.389708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:18.390151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] PATH_INFO: `/v3/projects/047dfcc3801d4d38a69da358d438b77e/users/f40ffe7d37af49f1bd0dc370aee91b61/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:18.395479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047dfcc3801d4d38a69da358d438b77e, user_id=f40ffe7d37af49f1bd0dc370aee91b61, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:18.402021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:18.435338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 807/1648] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:18 2022] PUT /identity/v3/projects/047dfcc3801d4d38a69da358d438b77e/users/f40ffe7d37af49f1bd0dc370aee91b61/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:19.535855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:19.538522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:19.572250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f3b72-05d3-40f2-a60b-999bdae8395d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:19.749885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:19.750557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:19.750843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:19.751286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] PATH_INFO: `/v3/projects/f6802c66c47f46918724cad633349ffd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:19.757131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6802c66c47f46918724cad633349ffd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:19.758418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:19.758418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: warnings.warn(msg) Sep 09 06:29:19.758418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: Sep 09 06:29:19.759966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:19.882791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:19.884918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:19.913577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c2fb-926a-4e05-ae60-34e706b58e57 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:19.914994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6802c66c47f46918724cad633349ffd', 'request_id': 'req-5bba873b-3110-4b64-b2b2-48aa530d83bf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:19.936337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6802c66c47f46918724cad633349ffd', 'request_id': 'req-5bba873b-3110-4b64-b2b2-48aa530d83bf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:19.960908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6802c66c47f46918724cad633349ffd', 'request_id': 'req-5bba873b-3110-4b64-b2b2-48aa530d83bf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.021507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] The token cache is being invalidate because project f6802c66c47f46918724cad633349ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:20.021892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.022671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5bba873b-3110-4b64-b2b2-48aa530d83bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.028452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 842/1649] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:19 2022] DELETE /identity/v3/projects/f6802c66c47f46918724cad633349ffd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:20.030980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c469bc-0cfd-4aa1-bb8d-22cb994bdd71 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.031285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c469bc-0cfd-4aa1-bb8d-22cb994bdd71 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.031567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c469bc-0cfd-4aa1-bb8d-22cb994bdd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.053444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.054181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.054534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.055007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] PATH_INFO: `/v3/users/27e3cd69d63044da8baf4c15830ec489` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.056364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e3cd69d63044da8baf4c15830ec489)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.057509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 06:29:20.057509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 09 06:29:20.057509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: Sep 09 06:29:20.059118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.084220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9c469bc-0cfd-4aa1-bb8d-22cb994bdd71 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:20.085087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9c469bc-0cfd-4aa1-bb8d-22cb994bdd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:20.113445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 843/1650] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:20.115548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.115890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.116191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.163986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:20.165288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:20.171430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e3cd69d63044da8baf4c15830ec489'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.173563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e3cd69d63044da8baf4c15830ec489'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.175487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e3cd69d63044da8baf4c15830ec489'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.187768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 844/1651] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:20.188933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.202091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e3cd69d63044da8baf4c15830ec489'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.205900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c9569-3152-4750-baf8-eca4d8dc67ca None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.234821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.235495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.235780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.236106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.237319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:20.238033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.239825 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.245529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf917d4a-17f5-4fbc-8175-46a8c416b9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e3cd69d63044da8baf4c15830ec489'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:20.267251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 845/1652] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:20.269809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 808/1653] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:19 2022] DELETE /identity/v3/users/27e3cd69d63044da8baf4c15830ec489 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:20.274218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.276539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.281550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.281550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.299685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c115e4-6db4-4c25-aeab-7752d4946963 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.336878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:20.340251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:20.453723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:20.456394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:20.498621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.499369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.499745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.500030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.500850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.502340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 809/1654] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:20.506001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.546454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.552460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:20.562123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 846/1655] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:20.563256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.690007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76e93-fbd1-4b77-945c-9dbd8a689311 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.696514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.697535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.698005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.698462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.699527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.702198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.742489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 847/1656] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:20.743768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.755839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8132b-fd35-4be9-a8a2-bd86e9ea14a6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.764739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c700cc-16de-4f1e-a5db-3032b302d2ce admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.772985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.774203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.774640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.775970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.777611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.781707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.805419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 848/1657] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:20.809208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.830828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b235ad-120a-4ef2-8a0c-64e0b90762a7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.839459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.840547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.840992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.841475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.842751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.845062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.872727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 849/1658] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:20.876722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:20.894215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac718e-d759-44f7-9539-3325ef9c69e0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:20.908092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.909035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:20.909498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.909857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:20.910265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.910629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.914388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:20.914700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] PATH_INFO: `/v3/projects/c76cbb49adea45128b92b3401e4370c7/users/5bdc96fb48454967bdd9d91fb0d0aef4/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:20.940039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.941705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c45913-9e3c-400c-a760-7b1b1a87dfad service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.953997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76cbb49adea45128b92b3401e4370c7, user_id=5bdc96fb48454967bdd9d91fb0d0aef4, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:20.956786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:20.973302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 810/1659] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:20.994142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 850/1660] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:20 2022] PUT /identity/v3/projects/c76cbb49adea45128b92b3401e4370c7/users/5bdc96fb48454967bdd9d91fb0d0aef4/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:20.996146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.000421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.000900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:21.054760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] MFA Rules not processed for user `5bdc96fb48454967bdd9d91fb0d0aef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:21.056715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:21.175142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 811/1661] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:21.176312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:21.259954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff94ab1-d93e-46bb-b6ae-9bd366dc4de0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:21.270607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:21.272334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.273386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.274085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:21.275227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:21.277839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:21.354432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 851/1662] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:21 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:21.358839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:21.373764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838ae9c-443e-47af-8bf0-7de75e71a0aa None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:21.437355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:21.501878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:21.503031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.503320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.507163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:21.507931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:21.510053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:21.556946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 812/1663] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:21 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:21.560587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:21.570332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:21.589454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a741e08-d6b1-4240-b835-b6c90c484147 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:21.612145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:21.615404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.615731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.619258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:21.621579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:21.628783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:21.656204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 852/1664] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:21.661100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:21.687163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd254c-bbed-41ba-a38b-104a113c0920 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:21.700895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:21.723792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.725109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.725109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] PATH_INFO: `/v3/projects/43141fd8c7284140abff8d40e34a9a5b/users/b4e14e15ce744ef79e0c092e00e10b28/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:21.770423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43141fd8c7284140abff8d40e34a9a5b, user_id=b4e14e15ce744ef79e0c092e00e10b28, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:21.777999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bab4-d4c3-420c-99eb-e5b08489867c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:21.809908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 813/1665] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:21 2022] PUT /identity/v3/projects/43141fd8c7284140abff8d40e34a9a5b/users/b4e14e15ce744ef79e0c092e00e10b28/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:21.819039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:21.846064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c499-e1b9-4f12-8a4b-6333dd8aac76 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:21.996856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:21.998661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:21.999147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:22.050519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:22.051149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:22.051427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:22.051703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:22.052354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:22.054538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:22.062907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] MFA Rules not processed for user `f40ffe7d37af49f1bd0dc370aee91b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:22.064816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:22.082333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 853/1666] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:29:22.083192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:22.104400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cbb11-a96a-4afb-9a3f-2a35c0ccdaa3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:22.118604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:22.119292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:22.119577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:22.119857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] PATH_INFO: `/v3/projects/43141fd8c7284140abff8d40e34a9a5b/users/b4e14e15ce744ef79e0c092e00e10b28/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:22.125843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43141fd8c7284140abff8d40e34a9a5b, user_id=b4e14e15ce744ef79e0c092e00e10b28, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:22.128494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace0cb7-2d55-4231-9da5-df913b5ef820 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:22.151971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 854/1667] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:22 2022] PUT /identity/v3/projects/43141fd8c7284140abff8d40e34a9a5b/users/b4e14e15ce744ef79e0c092e00e10b28/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:22.163256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:22.163648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:22.164484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:22.235114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 814/1668] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:22.253094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] MFA Rules not processed for user `b4e14e15ce744ef79e0c092e00e10b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:22.254371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:22.366571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 855/1669] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:22.375606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:22.377768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:22.538948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a7dca-13e7-4dcc-be96-2debb34ea072 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:22.674797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:22.696455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:22.697142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:22.697420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:22.697688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:22.724398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:22.725954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:22.760895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 815/1670] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:22.906270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:23.068074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2124b-913e-4c45-b84d-a2270bd2fbb8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:23.086501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:23.088063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.088465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.089224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] PATH_INFO: `/v3/users/5bdc96fb48454967bdd9d91fb0d0aef4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.091191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdc96fb48454967bdd9d91fb0d0aef4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:23.094987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:23.098973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:23.280146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdc96fb48454967bdd9d91fb0d0aef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.297658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:23.299119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:23.324698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98a89-289e-40ee-969e-f40a2de8fe77 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:23.326843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdc96fb48454967bdd9d91fb0d0aef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.327865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdc96fb48454967bdd9d91fb0d0aef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.337857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:23.338709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.338994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.339271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] PATH_INFO: `/v3/projects/4d59b785f4444662a1befc4bc9db25a6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.348181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d59b785f4444662a1befc4bc9db25a6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:23.350733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:23.353494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdc96fb48454967bdd9d91fb0d0aef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.355695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-547fbe8a-6442-4d60-99db-c1901a477a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdc96fb48454967bdd9d91fb0d0aef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.390728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 856/1671] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:22 2022] DELETE /identity/v3/users/5bdc96fb48454967bdd9d91fb0d0aef4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:23.395377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4e98-7b4a-4676-953c-130de445f81b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.395671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4e98-7b4a-4676-953c-130de445f81b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.396057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4e98-7b4a-4676-953c-130de445f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.439180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b93e4e98-7b4a-4676-953c-130de445f81b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:23.440391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b93e4e98-7b4a-4676-953c-130de445f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:23.469864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d59b785f4444662a1befc4bc9db25a6', 'request_id': 'req-d527d42f-8d15-47a2-bae4-6b2c60f56017'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.485771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d59b785f4444662a1befc4bc9db25a6', 'request_id': 'req-d527d42f-8d15-47a2-bae4-6b2c60f56017'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.493406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d59b785f4444662a1befc4bc9db25a6', 'request_id': 'req-d527d42f-8d15-47a2-bae4-6b2c60f56017'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.535577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] The token cache is being invalidate because project 4d59b785f4444662a1befc4bc9db25a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:23.535893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.538307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d527d42f-8d15-47a2-bae4-6b2c60f56017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:23.544983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 816/1672] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:23 2022] DELETE /identity/v3/projects/4d59b785f4444662a1befc4bc9db25a6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:23.549815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.550013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.550428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.570583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 857/1673] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:23.603018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:23.604467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:23.633629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 817/1674] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:23.635348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.635928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.636356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.705609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:23.713370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:23.731547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 858/1675] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:23.736195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:23.741960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:23.747694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:23.757439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4832e-47f0-498f-a7f2-3b20766f85b4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:23.782256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:23.782996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.783596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.784528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.788738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:23.791268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:23.800869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:23.851084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 818/1676] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:23.856051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:23.887619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6afa-0e6a-4cf7-9014-39c5c0986896 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:23.910696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:23.911436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.911792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.912722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.913492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:23.915581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:23.958429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5be3-35c2-4bda-b806-66cb798f5790 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:23.969427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:23.970065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:23.970424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:23.970703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:23.992943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:23.994575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:23.996694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 819/1677] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:23 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:24.000827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.024238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 859/1678] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:24.093341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.094807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:24.118577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9dfb-2f7c-4a18-9514-d72421ea2001 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:24.146956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:24.159693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c6856-d231-4346-b567-820e3e45de6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:24.176400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:24.177219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.177672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.178055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.179549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:24.181228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:24.227306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 820/1679] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:23 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:24.230844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.258503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834d7db-4cb6-4e67-a3ca-9cfaf7da0040 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:24.264053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:24.265062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.265502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.265874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] PATH_INFO: `/v3/users/d9430b8d3d4b4228884a41b004e6891b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.272450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9430b8d3d4b4228884a41b004e6891b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:24.274463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:24.280828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:24.287677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.288131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.288472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.289270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:24.290981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:24.380419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 821/1680] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:24.383152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.414537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e0e5-b433-4c32-a373-2615483b06a0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:24.437817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:24.438777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.439233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.439617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.440488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:24.441733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9430b8d3d4b4228884a41b004e6891b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:24.443442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:24.447734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:24.467039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9430b8d3d4b4228884a41b004e6891b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:24.473142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9430b8d3d4b4228884a41b004e6891b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:24.483152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 822/1681] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:24.487460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.502855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9430b8d3d4b4228884a41b004e6891b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:24.503647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a843053b-09f5-44bc-91e5-273ac6874c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9430b8d3d4b4228884a41b004e6891b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:24.523648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e766c-4edd-4ad2-9b20-defcf41635a7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:24.530931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 860/1682] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:24 2022] DELETE /identity/v3/users/d9430b8d3d4b4228884a41b004e6891b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:24.535206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.535493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.535774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.546369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:24.547064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.547358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.547617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] PATH_INFO: `/v3/projects/769f66cd78514fd9b55a64d08df7f657/users/29a8a234464741d18d83d989d9434424/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.586503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=769f66cd78514fd9b55a64d08df7f657, user_id=29a8a234464741d18d83d989d9434424, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:24.589259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a501a-d337-44b8-8039-452238b45ddb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:24.622070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 823/1683] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:24 2022] PUT /identity/v3/projects/769f66cd78514fd9b55a64d08df7f657/users/29a8a234464741d18d83d989d9434424/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:24.634256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:24.635704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:24.640036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:24.640552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:24.640990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:24.716838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] MFA Rules not processed for user `29a8a234464741d18d83d989d9434424`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:24.718348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:24.815145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 861/1684] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:24.824868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 824/1685] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:24.835459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.836953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:24.911521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:24.951624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:24.953817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:25.042678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2517-555d-4851-94ab-8cfe6246189c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:25.068906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:25.069555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.069844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.075619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.101577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:25.106185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848f9f-f921-4864-a23e-0b8c02f794f9 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:25.139266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 862/1686] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:25.144729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2674c-0cd6-4488-8d19-122de312f6f7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:25.151080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:25.151725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.152013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.152291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.168472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:25.171362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:25.186047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 825/1687] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:25.426403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7793-dc92-4c59-882d-942481ce7903 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.426403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7793-dc92-4c59-882d-942481ce7903 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.426701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7793-dc92-4c59-882d-942481ce7903 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.428617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 863/1688] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:29:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:25.476301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:25.478110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:25.500962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652eef-98a9-4929-928b-648647f920d6 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:25.508281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:25.509028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.509536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.509958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] PATH_INFO: `/v3/users/29a8a234464741d18d83d989d9434424` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.511250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a8a234464741d18d83d989d9434424)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:25.513382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:25.526367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.526658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.526949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.581778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:25.583069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:25.622244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a8a234464741d18d83d989d9434424'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:25.622693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a8a234464741d18d83d989d9434424'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:25.627758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a8a234464741d18d83d989d9434424'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:25.637963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a8a234464741d18d83d989d9434424'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:25.640784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:25.711689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afccc70f-477b-4229-9d53-356182d9c555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a8a234464741d18d83d989d9434424'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:25.753604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 826/1689] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:25 2022] DELETE /identity/v3/users/29a8a234464741d18d83d989d9434424 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:25.761540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:25.762147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:25.762762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:25.785505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 864/1690] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:29:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 09 06:29:25.802063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:25.806962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:25.824682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:25.826133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:25.851729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ab9f8-874a-4efa-92c9-882a9108c4c1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:25.955253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 827/1691] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:26.015032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:26.016551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:26.016890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:26.017174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:26.022045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:26.023718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:26.050388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:26.052665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:26.069591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 865/1692] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:26.164381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65dd2-005d-4cf0-97bb-a32097dcf8e9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:26.169552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:26.170781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:26.171371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:26.171852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:26.188945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:26.190830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:26.210146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 828/1693] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:26.502501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:26.504776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:26.538203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f57e-baa9-4bb3-b713-04c24e494399 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:26.549437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:26.551645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:26.551830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:26.554498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] PATH_INFO: `/v3/projects/c76cbb49adea45128b92b3401e4370c7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:26.557379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76cbb49adea45128b92b3401e4370c7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:26.559891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:26.704078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:26.720967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76cbb49adea45128b92b3401e4370c7', 'request_id': 'req-8ca69444-c282-49d1-9700-2b8eb37b42d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:26.736427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76cbb49adea45128b92b3401e4370c7', 'request_id': 'req-8ca69444-c282-49d1-9700-2b8eb37b42d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:26.758901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76cbb49adea45128b92b3401e4370c7', 'request_id': 'req-8ca69444-c282-49d1-9700-2b8eb37b42d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:26.825893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] The token cache is being invalidate because project c76cbb49adea45128b92b3401e4370c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:26.825893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:26.826462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:26.829425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 866/1694] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:26 2022] DELETE /identity/v3/projects/c76cbb49adea45128b92b3401e4370c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:26.834215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:26.852827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9880a1-5d0d-4703-882e-bd9b60b6d6a2 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:27.003417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:27.004360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:27.005131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:27.005131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] PATH_INFO: `/v3/users/b4e14e15ce744ef79e0c092e00e10b28` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:27.007758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e14e15ce744ef79e0c092e00e10b28)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:27.008953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:27.068557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:27.116590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e14e15ce744ef79e0c092e00e10b28'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.117347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e14e15ce744ef79e0c092e00e10b28'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.118773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e14e15ce744ef79e0c092e00e10b28'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.137708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e14e15ce744ef79e0c092e00e10b28'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.199484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e14e15ce744ef79e0c092e00e10b28'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.249057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 829/1695] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:26 2022] DELETE /identity/v3/users/b4e14e15ce744ef79e0c092e00e10b28 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:27.478994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:27.481309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:27.516275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca69444-c282-49d1-9700-2b8eb37b42d8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:27.553286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:27.555003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:27.629179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:27.629940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:27.630335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:27.644344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] PATH_INFO: `/v3/projects/3e82a41b1d0d49e487e050a4192e7d9b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:27.646060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e82a41b1d0d49e487e050a4192e7d9b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:27.648223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:27.705065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd566b-82c5-4e0d-9b61-fa69d218395b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:27.747614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e82a41b1d0d49e487e050a4192e7d9b', 'request_id': 'req-a0111ef5-63ed-477a-8d10-890c7d0e30d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.761199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e82a41b1d0d49e487e050a4192e7d9b', 'request_id': 'req-a0111ef5-63ed-477a-8d10-890c7d0e30d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.776091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e82a41b1d0d49e487e050a4192e7d9b', 'request_id': 'req-a0111ef5-63ed-477a-8d10-890c7d0e30d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.793343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] The token cache is being invalidate because project 3e82a41b1d0d49e487e050a4192e7d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:27.793646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.794547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0111ef5-63ed-477a-8d10-890c7d0e30d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.803152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 867/1696] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:27 2022] DELETE /identity/v3/projects/3e82a41b1d0d49e487e050a4192e7d9b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:27.806135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67a85-ffec-4d9f-82fd-73a06061f205 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:27.806436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67a85-ffec-4d9f-82fd-73a06061f205 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:27.806717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67a85-ffec-4d9f-82fd-73a06061f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:27.843846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:27.844820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:27.845145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:27.845414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] PATH_INFO: `/v3/projects/769f66cd78514fd9b55a64d08df7f657` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:27.846804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] RBAC: Authorizing `identity:delete_project(project_id=769f66cd78514fd9b55a64d08df7f657)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:27.849027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:27.872262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c7e67a85-ffec-4d9f-82fd-73a06061f205 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:27.876072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c7e67a85-ffec-4d9f-82fd-73a06061f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:27.924538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 868/1697] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:27.924538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879558ab-271b-48bf-abbc-1a7e812bd84b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:27.924538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879558ab-271b-48bf-abbc-1a7e812bd84b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:27.924538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879558ab-271b-48bf-abbc-1a7e812bd84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:27.963360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769f66cd78514fd9b55a64d08df7f657', 'request_id': 'req-5b8d4657-a6f7-4dab-812e-9a09f177619b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.966310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:27.977740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769f66cd78514fd9b55a64d08df7f657', 'request_id': 'req-5b8d4657-a6f7-4dab-812e-9a09f177619b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:27.993869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769f66cd78514fd9b55a64d08df7f657', 'request_id': 'req-5b8d4657-a6f7-4dab-812e-9a09f177619b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.019828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] The token cache is being invalidate because project 769f66cd78514fd9b55a64d08df7f657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:28.020127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.021175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-879558ab-271b-48bf-abbc-1a7e812bd84b None None] MFA Rules not processed for user `3736d59b92ef4feb910f6d39d7ac804c`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:28.022927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b8d4657-a6f7-4dab-812e-9a09f177619b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.024463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-879558ab-271b-48bf-abbc-1a7e812bd84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.031141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 830/1698] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:27 2022] DELETE /identity/v3/projects/769f66cd78514fd9b55a64d08df7f657 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:28.031141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a9ce-ca5b-4ebd-997d-640a9e42ce00 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.031141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a9ce-ca5b-4ebd-997d-640a9e42ce00 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.031141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458a9ce-ca5b-4ebd-997d-640a9e42ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.097543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a458a9ce-ca5b-4ebd-997d-640a9e42ce00 None None] MFA Rules not processed for user `f856533ec21848db82c0fef655013f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:28.102960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a458a9ce-ca5b-4ebd-997d-640a9e42ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.153934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:28.217888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 869/1699] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:28.219446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.219769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.220053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.282709 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:28.283404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.296629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 831/1700] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:28.296629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611bee6-3d1a-4ed4-bedc-3aad400d50c8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.296629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611bee6-3d1a-4ed4-bedc-3aad400d50c8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.296629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611bee6-3d1a-4ed4-bedc-3aad400d50c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.336614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d611bee6-3d1a-4ed4-bedc-3aad400d50c8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:28.344652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d611bee6-3d1a-4ed4-bedc-3aad400d50c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.421111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 870/1701] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:28.421986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:28.423355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.452043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6185a-b2a7-484d-8362-176eea0dafc1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:28.466184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:28.466849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.467142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.467418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] PATH_INFO: `/v3/users/7faaad3f75da43a8b51b078306a50319` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.472107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 832/1702] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:28.473462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.473753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.474030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.479782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7faaad3f75da43a8b51b078306a50319)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:28.496015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:28.536087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] MFA Rules not processed for user `3736d59b92ef4feb910f6d39d7ac804c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:28.538189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.550951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 833/1703] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:28.551879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:28.553332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.616695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7faaad3f75da43a8b51b078306a50319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.657930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7faaad3f75da43a8b51b078306a50319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.660425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7faaad3f75da43a8b51b078306a50319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.688550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7faaad3f75da43a8b51b078306a50319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.689682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7faaad3f75da43a8b51b078306a50319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:28.702640 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:28.749772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fef361-66bd-4d0f-bab4-075067d13060 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:28.750340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 871/1704] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:28 2022] DELETE /identity/v3/users/7faaad3f75da43a8b51b078306a50319 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:28.751382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:28.758041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.913378 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:28.914095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:28.914600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:28.915012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:28.917398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:28.962086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:28.977037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6fd63-e81a-4cfe-95f3-131d4152ff8b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.008481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.009201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.009482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.009757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.010572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:29.010944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.013126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14f3a-86b9-4bc0-bea5-4e8538cc7d75 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.047454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 872/1705] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:29.053866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.054191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.054479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.101639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:29.105438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.107103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.113009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.128053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 873/1706] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:29.130393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.137795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.143504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 834/1707] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:29.146918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.152997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.170523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e87f-ff10-4dc1-8d28-637629edcccd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.188181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.188843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.189162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.189543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.198051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.202694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae7aac-7b52-425b-a959-564b25b74aa3 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.220226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.222129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.225290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.225813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] PATH_INFO: `/v3/projects/43141fd8c7284140abff8d40e34a9a5b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.228763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43141fd8c7284140abff8d40e34a9a5b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.233674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.350678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.354559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.358579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43141fd8c7284140abff8d40e34a9a5b', 'request_id': 'req-fd14e975-b4d9-4aae-b464-d625bf045821'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:29.376971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 874/1708] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:29.377475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43141fd8c7284140abff8d40e34a9a5b', 'request_id': 'req-fd14e975-b4d9-4aae-b464-d625bf045821'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:29.390780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.398020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43141fd8c7284140abff8d40e34a9a5b', 'request_id': 'req-fd14e975-b4d9-4aae-b464-d625bf045821'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:29.422522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] The token cache is being invalidate because project 43141fd8c7284140abff8d40e34a9a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:29.422931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:29.424027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:29.430123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4d03-35b7-45ba-b55e-398df1f5e174 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.433091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 835/1709] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:29 2022] DELETE /identity/v3/projects/43141fd8c7284140abff8d40e34a9a5b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:29.434801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.443219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.533193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:29.657949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.658647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.658875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.659166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.659852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.661232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e975-b4d9-4aae-b464-d625bf045821 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.664603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4437b9-3e5c-4e97-a9d2-470cbcd2058a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.678575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.679219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.679492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.679776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.680501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:29.680921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.686136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.712243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 836/1710] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:29.716144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.720889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.728452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 875/1711] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:29.733133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.733429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.733734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.755043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f02c-adc5-47f0-87ed-eb5631704772 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:29.786842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:29.788596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:29.891100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:29.891800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:29.892092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:29.892379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] PATH_INFO: `/v3/projects/3d7a54c72fa44766923e5138caca22ee` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:29.895893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7a54c72fa44766923e5138caca22ee)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:29.897288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:29.949522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 876/1712] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:29.950403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:29.970728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e4680-03ec-45e7-9fd3-cde626e081ea None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.000094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.000800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.001091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.001369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.002016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.008832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.021409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:30.055132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7a54c72fa44766923e5138caca22ee', 'request_id': 'req-4aceb137-2634-4ec3-986f-7e02a9bff84d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.073030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7a54c72fa44766923e5138caca22ee', 'request_id': 'req-4aceb137-2634-4ec3-986f-7e02a9bff84d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.093323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 877/1713] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:29 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:30.094350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.094535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7a54c72fa44766923e5138caca22ee', 'request_id': 'req-4aceb137-2634-4ec3-986f-7e02a9bff84d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.096091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.123926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] The token cache is being invalidate because project 3d7a54c72fa44766923e5138caca22ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:30.124451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.128659 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4aceb137-2634-4ec3-986f-7e02a9bff84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.131343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 837/1714] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:29 2022] DELETE /identity/v3/projects/3d7a54c72fa44766923e5138caca22ee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:30.133005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.133570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.134002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.174444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:30.180153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.197765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 838/1715] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:30.199026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.200450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.217303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aca7c-58ee-45b3-9bc3-834ca1ad2a61 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.221341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14920-32e6-4d2c-9d9a-4eaa083b0b77 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.224073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.225182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.225625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.226053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.226972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.227497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.228359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.228914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.229204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.229968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.232217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.233649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.269209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 839/1716] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:30 2022] POST /identity/v3/users => generated 288 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:30.270525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.274342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.292370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52a6c9-ef80-41c5-89fd-d3ac304fe684 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.298686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 878/1717] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:30 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:30.299421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.300253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.300916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.301433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.301986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] PATH_INFO: `/v3/users/f40ffe7d37af49f1bd0dc370aee91b61` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.304368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40ffe7d37af49f1bd0dc370aee91b61)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.306723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.327024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:30.332354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af433065-f202-46c3-ad87-4e0b04981ff9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.360676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.361340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.361607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.361934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.362685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:30.362995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.365336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.397835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 879/1718] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:30.399503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.421419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40ffe7d37af49f1bd0dc370aee91b61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.431133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747b28a-a393-4153-a909-59b395455c7e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.431905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40ffe7d37af49f1bd0dc370aee91b61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.440625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40ffe7d37af49f1bd0dc370aee91b61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.453291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.454190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.454584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.454952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.455741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.458089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.463340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40ffe7d37af49f1bd0dc370aee91b61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.482590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 880/1719] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:30.483813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.490659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.519443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442e50-c556-4d27-86af-6584379cb433 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.529873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40ffe7d37af49f1bd0dc370aee91b61'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:30.532711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.533460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.534144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.534427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.535133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.548807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.563224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 840/1720] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:30 2022] DELETE /identity/v3/users/f40ffe7d37af49f1bd0dc370aee91b61 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:30.567246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.569319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.577018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 881/1721] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:30.578283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.583271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:30.635356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120905b-af07-4928-bd61-b4b5b22c31a2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.737926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6dd8d-8908-40eb-8855-5a9234e7678f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:30.757393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.758043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.758507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.759004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.776986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.778893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:30.781062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.781564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.783050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.783608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.785172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:30.797436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0baff-2888-48cf-8206-e12147ce9374 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:30.830080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 882/1722] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:30.840375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933b2b-115a-44c7-bf92-75aa513e2e7d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:30.844858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933b2b-115a-44c7-bf92-75aa513e2e7d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:30.845287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e933b2b-115a-44c7-bf92-75aa513e2e7d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:30.852445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 883/1723] 10.222.0.30 () {54 vars in 912 bytes} [Fri Sep 9 06:29:30 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:30.853762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933b2b-115a-44c7-bf92-75aa513e2e7d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.859335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 841/1724] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:30 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:30.861387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:30.983490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:31.045739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e933b2b-115a-44c7-bf92-75aa513e2e7d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.050742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c2774-d4f2-460c-b1ea-d6147e4c63e5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.062485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.063322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.064119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.064420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.066898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.078605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.079780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f475a80-b807-4de3-a911-7b0250ddfca2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.080199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.081753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.082108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] PATH_INFO: `/v3/projects/3f7413139dad4ee0bba7a1e99a283c20/users/123e8be64beb46dfb5fe751628a4a3c5/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.113083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 884/1725] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:31.115354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.115762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.116049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.124353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7413139dad4ee0bba7a1e99a283c20, user_id=123e8be64beb46dfb5fe751628a4a3c5, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.130028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.150657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:31.169233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 842/1726] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:30 2022] PUT /identity/v3/projects/3f7413139dad4ee0bba7a1e99a283c20/users/123e8be64beb46dfb5fe751628a4a3c5/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:31.170394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:31.243974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:31.245276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.351825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6fbc-7fa5-4f62-8a73-612d0505a91b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.358441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.359075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.359355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.359634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.360291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.362267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.385521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 885/1727] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:31.386558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:31.388004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.390475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 843/1728] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:31 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:31.394564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:31.410470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ce8b-763b-4f94-81bb-7e28c37d21d6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.410665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b66d-ff77-4a28-9b44-1dc98a5a0cb5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.419172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.419833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.420119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.420417 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] PATH_INFO: `/v3/projects/047dfcc3801d4d38a69da358d438b77e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.421557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.422233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.422510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.422822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] PATH_INFO: `/v3/projects/598e9fe4dde543deb243732d3279c92c/users/1f5b0a4a7c5c45eca70cd6f9b721d15c/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.424287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047dfcc3801d4d38a69da358d438b77e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.426246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.458353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=598e9fe4dde543deb243732d3279c92c, user_id=1f5b0a4a7c5c45eca70cd6f9b721d15c, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.461591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cf319-f349-4f5f-94d4-743f77a46bcf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.486748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 844/1729] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:31 2022] PUT /identity/v3/projects/598e9fe4dde543deb243732d3279c92c/users/1f5b0a4a7c5c45eca70cd6f9b721d15c/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:31.489268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.490504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.490504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.525235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047dfcc3801d4d38a69da358d438b77e', 'request_id': 'req-dde54663-9a4d-42dc-b248-db9d87eb1543'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:31.551706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047dfcc3801d4d38a69da358d438b77e', 'request_id': 'req-dde54663-9a4d-42dc-b248-db9d87eb1543'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:31.570302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047dfcc3801d4d38a69da358d438b77e', 'request_id': 'req-dde54663-9a4d-42dc-b248-db9d87eb1543'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:31.572399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] MFA Rules not processed for user `123e8be64beb46dfb5fe751628a4a3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:31.580022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.595633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] The token cache is being invalidate because project 047dfcc3801d4d38a69da358d438b77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:31.596088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:31.601792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:31.604676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 886/1730] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:31 2022] DELETE /identity/v3/projects/047dfcc3801d4d38a69da358d438b77e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:31.609038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:31.610785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.738514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 845/1731] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:31.739546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:31.745031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.801235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54663-9a4d-42dc-b248-db9d87eb1543 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.805974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.806660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.807456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.807456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.812053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:31.821392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:31.836970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.838654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5ddbb-1ca2-421f-93f7-cd41f1a83ff3 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.851434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 887/1732] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:31.853852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62147-6459-4591-bd22-00de1d73c9f9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.854564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62147-6459-4591-bd22-00de1d73c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.855098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62147-6459-4591-bd22-00de1d73c9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.905943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:31.939941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d81c2-58cb-4263-90ca-b0ef607ce603 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:31.947731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:31.948714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.949257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.949768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.952798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:31.955009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b09458-12cc-4256-a9be-b3cae24a328f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:31.972587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 846/1733] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:31.974400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:31.974898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:31.975003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b7e62147-6459-4591-bd22-00de1d73c9f9 None None] MFA Rules not processed for user `1f5b0a4a7c5c45eca70cd6f9b721d15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:31.975489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:31.981761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b7e62147-6459-4591-bd22-00de1d73c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.094346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:32.098819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.145090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 847/1734] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:32.146521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:32.147463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.178351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b10e0-94a4-4898-9dc5-abd20ee501d6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:32.218382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:32.219578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.220222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.220868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.221803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:32.224992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:32.246405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 888/1735] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:32.250283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0849-26c9-4be5-a51c-32508651537f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.250283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0849-26c9-4be5-a51c-32508651537f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.250283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0849-26c9-4be5-a51c-32508651537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.297896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 848/1736] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:32.298875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:32.363385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-642e0849-26c9-4be5-a51c-32508651537f None None] MFA Rules not processed for user `f920842016e14eb8b43ba27912116e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:32.365241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-642e0849-26c9-4be5-a51c-32508651537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.410516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26020-a3e4-4d67-a9e4-faed0adf8c00 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:32.430922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:32.431631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.431870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.432145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.432830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:32.434444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a226f89-c872-416d-a603-7dbe5dd49ec2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:32.477631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 849/1737] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:32.479172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.479487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.486709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.526464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:32.537845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.549624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 889/1738] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:32.551357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e0849-26c9-4be5-a51c-32508651537f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:32.559639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-642e0849-26c9-4be5-a51c-32508651537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.566906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 850/1739] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:32.571232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:32.587100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e0849-26c9-4be5-a51c-32508651537f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:32.599514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c9e37-caaf-4ee4-8e9a-bd358efedffd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:32.612541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:32.617270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.618024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.619455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.623269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:32.624103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:32.625056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.625462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.629721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.630668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:32.633309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dd167-5823-43af-acef-5b19bf271944 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:32.640114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:32.694912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 851/1740] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:32.696258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:32.714902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 890/1741] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:32.717006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.717573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.718219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.730401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938ab5-12eb-4a79-934e-5b7b69fe7904 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:32.805460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] MFA Rules not processed for user `f920842016e14eb8b43ba27912116e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:32.807127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:32.958247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:32.959305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:32.959770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:32.960291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] PATH_INFO: `/v3/projects/0acaac036d574437b189aab6533556b2/users/cfe3a5d974eb48dd90497ec85598bf8c/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:32.961540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:32.984905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 891/1742] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:32.985792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.004284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acaac036d574437b189aab6533556b2, user_id=cfe3a5d974eb48dd90497ec85598bf8c, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.007959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.011777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ea140-fa6c-4805-8549-30527f1c500c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.016744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.017516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.017926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.018263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.019446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:33.019824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.022125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.043923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 892/1744] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:33.043923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.047633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 852/1744] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:32 2022] PUT /identity/v3/projects/0acaac036d574437b189aab6533556b2/users/cfe3a5d974eb48dd90497ec85598bf8c/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:33.048899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.051294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef07a-4805-433a-81a3-a8b6ad97991e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.089666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:33.182400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055235e-8cb8-4996-8fff-65f5c76ef31f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.188718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.189357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.189695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.189975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.190824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.193055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.245332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 853/1745] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:33 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:33.253278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.255551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.256194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.256479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.256783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.257704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.259332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.261666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:33.296797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 893/1746] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:33.298146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.313239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:33.439788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea212-7e3a-4a34-8645-14878d95db04 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.459619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.460310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.460623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.460932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.486130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f48af-18b5-4893-a137-ec774619af33 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.495907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.496849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.497231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.497605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.500082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:33.516256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.518062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.535113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 894/1747] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:33.536188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.551490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd1365-4bef-47c6-8a68-d4474f8df0c8 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.566368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.568545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.569619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.569960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.575206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.578955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.614499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.616966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec7dd-013f-4e23-b4ae-c1b1f7fa3d90 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.634788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 854/1748] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:33.636201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4890a-4c1d-45f5-90f6-74fd0fc2fe15 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.636777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4890a-4c1d-45f5-90f6-74fd0fc2fe15 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.637138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4890a-4c1d-45f5-90f6-74fd0fc2fe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.651655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 895/1749] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:33 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:33.652524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.722834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d4b4890a-4c1d-45f5-90f6-74fd0fc2fe15 None None] MFA Rules not processed for user `cfe3a5d974eb48dd90497ec85598bf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:33.725345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d4b4890a-4c1d-45f5-90f6-74fd0fc2fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:33.797137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:33.847884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb17f-7040-47a0-9ec2-c729880daedd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.858093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.858737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.859011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.859280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.860024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.861693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.869532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:33.900034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 896/1750] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:33.900034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:33.917957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892c87-07eb-44aa-9788-00906871fe7a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:33.929072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:33.937819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.937819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.938119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] PATH_INFO: `/v3/projects/8cace49f129448e9941c6932e6ffd7b4/users/f7e070d3e90b42619559780bdf3a139b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.961666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cace49f129448e9941c6932e6ffd7b4, user_id=f7e070d3e90b42619559780bdf3a139b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:33.964730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:33.971833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 855/1751] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:33.979692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:33.981237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:33.981395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:33.998632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 897/1752] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:33 2022] PUT /identity/v3/projects/8cace49f129448e9941c6932e6ffd7b4/users/f7e070d3e90b42619559780bdf3a139b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:33.999789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.073867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] MFA Rules not processed for user `f534b7b5831d4dfc9da5641553c9f635`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:34.075121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:34.126213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d425-a1fa-451f-8800-fe11318b044a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.137892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.138717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.139004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.140273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.141254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.148996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.198319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 898/1753] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:33 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:34.200063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.211882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 856/1754] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:34.212928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.221977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a41a7-9c70-40c2-b6bb-3714f7cd9aa1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.228962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.230084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.230451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.230983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] PATH_INFO: `/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90/users/80c128681e02441ebb21e61448e53c55/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.244478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d7de-1f8d-4815-8a85-1b2a3ef94fde None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.249823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.250722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.251343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.251816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.252821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.255105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.288278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4350a3c11a43eda9dd89aa599dcb90, user_id=80c128681e02441ebb21e61448e53c55, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.293771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.320184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 899/1755] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:34 2022] PUT /identity/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90/users/80c128681e02441ebb21e61448e53c55/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:34.320184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.321202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 857/1756] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:34 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:34.322960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.426995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6517-aae4-45d6-a3b1-d5684d227d47 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.443621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.444986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.445511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.446431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.447542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.454928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.474813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4be4-bdb7-4e0e-850e-c7e5a5a9fc71 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.481418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 858/1757] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:34.484602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.488727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.489435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.489758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.490016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:34.490233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.490809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.492780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.537931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 900/1758] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:34.538666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.567128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bea5a2-12e3-400d-a19f-1c8ac267e57a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.574195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.574853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.575210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.575421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.576362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.579651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.596940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:34.597589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 901/1759] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:34.598665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.617148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a2d98-85d8-4fea-a8e0-410fef433e50 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.623918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.625231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.625522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.625969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.626647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.628819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.639642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:34.650872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e84f-59c6-442f-9c6a-7768fa08e600 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.666345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 902/1760] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:34 2022] POST /identity/v3/users => generated 300 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:34.666345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.669064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.669941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.670229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.670527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.680591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648724fd-aee0-40f9-90c7-63733befeaa5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.686929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.687795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.688358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.688866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.689906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.691701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.704543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 903/1761] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:34.705593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.720872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9015-ce68-4245-8467-3e4842b432ab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.728168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.729022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.729621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.730004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] PATH_INFO: `/v3/projects/8cace49f129448e9941c6932e6ffd7b4/users/f7e070d3e90b42619559780bdf3a139b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.732397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cace49f129448e9941c6932e6ffd7b4, user_id=f7e070d3e90b42619559780bdf3a139b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.735549 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.749773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 904/1762] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:34 2022] PUT /identity/v3/projects/8cace49f129448e9941c6932e6ffd7b4/users/f7e070d3e90b42619559780bdf3a139b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:34.751017 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.795319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:34.802775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:34.830831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 859/1763] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:34.832994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:34.859446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42988-47f6-43a4-bc70-6f4bfa113f2c service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.946436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b644c8-02e7-4ba3-b717-aadffc2bdb69 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:34.966739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:34.970235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:34.972015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:34.973365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] PATH_INFO: `/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90/users/80c128681e02441ebb21e61448e53c55/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:34.981464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4350a3c11a43eda9dd89aa599dcb90, user_id=80c128681e02441ebb21e61448e53c55, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:35.005247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:35.044754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 905/1764] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:34 2022] PUT /identity/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90/users/80c128681e02441ebb21e61448e53c55/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:35.051357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:35.105359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:35.111715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.112193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.112834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.118953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:35.123290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d2ce-8e3c-44f1-89cd-ce553ebc3ece admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:35.168004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 860/1765] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:35.181036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.181036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.181036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.314117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] MFA Rules not processed for user `f7e070d3e90b42619559780bdf3a139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:35.322285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:35.339432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4dd2-75e4-4718-8d54-05d2eb1cea06 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:35.350962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:35.351820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.352500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.352914 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] PATH_INFO: `/v3/projects/d40a5b7af3224644b02544be8af3b5a7/users/f5384db48b164665ae46f9a5b7635fa9/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.397713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40a5b7af3224644b02544be8af3b5a7, user_id=f5384db48b164665ae46f9a5b7635fa9, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:35.408012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872bba4-f014-45fa-b315-2727e4e4896f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:35.437320 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 906/1766] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:35 2022] PUT /identity/v3/projects/d40a5b7af3224644b02544be8af3b5a7/users/f5384db48b164665ae46f9a5b7635fa9/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:35.439870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c98-5a54-4d45-89d8-6f9d39577faa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.442897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c98-5a54-4d45-89d8-6f9d39577faa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.443448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c98-5a54-4d45-89d8-6f9d39577faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.522644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:35.532841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-45eb6c98-5a54-4d45-89d8-6f9d39577faa None None] MFA Rules not processed for user `80c128681e02441ebb21e61448e53c55`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:35.536879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45eb6c98-5a54-4d45-89d8-6f9d39577faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:35.543670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 861/1767] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:35.549086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:35.568446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bcecf-448f-4021-b6e6-bf8e8e4064ac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:35.670083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:35.751178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 907/1768] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:35.752736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac34c-7182-4191-aa08-9a5e90d0d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.753145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac34c-7182-4191-aa08-9a5e90d0d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.753531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac34c-7182-4191-aa08-9a5e90d0d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.792407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:35.793147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:35.793436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:35.793712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] PATH_INFO: `/v3/projects/80e382c2180544ae97d1781f0ce777cb/users/47647f88298b4f27b559af9bf3ac1e28/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:35.833747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e382c2180544ae97d1781f0ce777cb, user_id=47647f88298b4f27b559af9bf3ac1e28, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:35.837002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:35.845999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-17bac34c-7182-4191-aa08-9a5e90d0d3e9 None None] MFA Rules not processed for user `f5384db48b164665ae46f9a5b7635fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:35.848492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-17bac34c-7182-4191-aa08-9a5e90d0d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:35.864651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 862/1769] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:35 2022] PUT /identity/v3/projects/80e382c2180544ae97d1781f0ce777cb/users/47647f88298b4f27b559af9bf3ac1e28/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:35.881192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:35.885564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:36.077872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049a55-080b-4abe-bca9-dc488dde8fa4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:36.083851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 908/1770] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:36.086391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6453-ae78-47a0-9f25-8554eec6a4b3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.087353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6453-ae78-47a0-9f25-8554eec6a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.089003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6453-ae78-47a0-9f25-8554eec6a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.089793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:36.090596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.091030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.091469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.141614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d9eb6453-ae78-47a0-9f25-8554eec6a4b3 None None] MFA Rules not processed for user `f856533ec21848db82c0fef655013f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:36.148802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d9eb6453-ae78-47a0-9f25-8554eec6a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:36.239801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:36.245126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:36.269220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 863/1771] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:36.271831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:36.275479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:36.305118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad10fa-3bb0-4792-b65d-6c5198006abe service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:36.308698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 909/1772] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:36.314333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.314333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.314333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.317289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:36.318276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.318674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.319079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.434758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] MFA Rules not processed for user `f920842016e14eb8b43ba27912116e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:36.441212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:36.444614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:36.551299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:36.553908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:36.582783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 864/1773] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:36.596012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:36.637700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 910/1774] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:36.644324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:36.674654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:36.846935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8cbdb-e70d-415d-a418-ec455b9420b1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:36.865625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:36.866268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.866391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.872775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.873738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:36.880926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:36.910567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0525f49-cd15-4b60-b406-b0f861b2adee service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:36.931426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:36.932344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:36.943468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:36.944285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:36.945224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:36.947362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 911/1775] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:36 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:36.950214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:36.952117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:36.988972 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 865/1776] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:36.990696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:37.090265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff9b79-11d7-4d9d-ae2f-8968bdb9aae4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:37.157277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a5c7-de0d-4c7f-9b6b-d901cb49493e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:37.168379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:37.170174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.170503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.170763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.347619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:37.348393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.350079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.350079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.350409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:37.359088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:37.420171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:37.422255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6304-eec3-43b4-9378-b416e47e7a4b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:37.429858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 866/1777] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:36 2022] POST /identity/v3/users => generated 296 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:37.430825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:37.435764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 912/1778] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:37.438057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42081-8380-480d-ade8-0040cfb8adb8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.438358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42081-8380-480d-ade8-0040cfb8adb8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.438651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42081-8380-480d-ade8-0040cfb8adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.486151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807126b-0eee-4571-b376-ae054031bfa8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:37.509206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:37.509965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.510243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.510549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] PATH_INFO: `/v3/projects/80e382c2180544ae97d1781f0ce777cb/users/47647f88298b4f27b559af9bf3ac1e28/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.531623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e382c2180544ae97d1781f0ce777cb, user_id=47647f88298b4f27b559af9bf3ac1e28, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:37.534358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:37.585826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 867/1779] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:37 2022] PUT /identity/v3/projects/80e382c2180544ae97d1781f0ce777cb/users/47647f88298b4f27b559af9bf3ac1e28/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:37.587132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:37.590739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0dc42081-8380-480d-ade8-0040cfb8adb8 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:37.591830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0dc42081-8380-480d-ade8-0040cfb8adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:37.632074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:37.705600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:37.786182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5980-f3b2-4fd2-b149-f5034a3e5b82 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:37.796694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:37.797349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.797635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.800426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.803701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:37.806812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:37.813804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 913/1780] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:37.816501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.820381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.822581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.837232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 868/1781] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:37.837567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:37.855261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7234ea-bba0-403e-8e1b-b22164f4e2d3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:37.871238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:37.872042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:37.872470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:37.872810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] PATH_INFO: `/v3/projects/4486079ab5524bf1b6d4c19c01c22248/users/40a18f52855e4a569e370b8548e3f0fd/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:37.935836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4486079ab5524bf1b6d4c19c01c22248, user_id=40a18f52855e4a569e370b8548e3f0fd, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:37.939042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] MFA Rules not processed for user `47647f88298b4f27b559af9bf3ac1e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:37.942424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:37.943833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:37.986977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 869/1782] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:37 2022] PUT /identity/v3/projects/4486079ab5524bf1b6d4c19c01c22248/users/40a18f52855e4a569e370b8548e3f0fd/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:37.991543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:38.121516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 914/1783] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:38.123315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:38.177735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e38d-cacb-4b24-b693-731a1fb3ec76 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:38.197043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:38.197938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.198381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.198826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.199650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:38.201702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:38.217835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 870/1784] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:38.218979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:38.227681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:38.326747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f2174-c752-44cc-823a-0d08321aa4b4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:38.465916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:38.466591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.466869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.469684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.492642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138740-73dc-4f72-b22e-c82d476047ef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:38.503785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:38.508383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:38.510760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.511270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.512390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.621840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:38.653886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:38.655678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:38.669655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 915/1785] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:38.670601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:38.687135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76422b-28b3-467f-ae34-b2811203d883 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:38.700490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:38.701757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.705840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.706190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] PATH_INFO: `/v3/projects/4486079ab5524bf1b6d4c19c01c22248/users/40a18f52855e4a569e370b8548e3f0fd/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.711042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:38.715608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4486079ab5524bf1b6d4c19c01c22248, user_id=40a18f52855e4a569e370b8548e3f0fd, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:38.716240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b2efa-db64-48ee-8540-0b44a5882e31 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:38.742331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28fad7-26f9-4480-8b50-92af97b23ea5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:38.792253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 871/1786] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:29:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:29:38.803094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 916/1787] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:38 2022] PUT /identity/v3/projects/4486079ab5524bf1b6d4c19c01c22248/users/40a18f52855e4a569e370b8548e3f0fd/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:38.818494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.820207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.820808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.824325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc202-6804-4531-898e-4f608077131c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.824755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc202-6804-4531-898e-4f608077131c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.827697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc202-6804-4531-898e-4f608077131c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.837332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 872/1788] 10.222.0.30 () {54 vars in 912 bytes} [Fri Sep 9 06:29:38 2022] GET /identity => generated 270 bytes in 44 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:38.851733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:38.854139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:38.854423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:38.897358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] MFA Rules not processed for user `40a18f52855e4a569e370b8548e3f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:38.898628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:39.078869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 917/1789] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:39.093975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:39.095264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:39.223010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:39.354407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 873/1790] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:39.387617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:39.395465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:39.424609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065dd3d-914c-4de4-a03b-ffb1b620054a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:39.429314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd3836-b9ad-45aa-b719-bffd908e9d73 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:39.441358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:39.442360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:39.442935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:39.443420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:39.453515 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:39.454558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:39.454948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:39.457283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:39.468830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:39.470650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:39.484430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:39.487258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 874/1791] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:39.490432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:39.524040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 918/1792] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:39.984610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:39.999992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb67e-e50f-4899-ae20-e381aad1152a service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:40.010316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:40.011278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:40.011726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:40.012181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:40.183258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:40.188179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712ba2-99c5-40e9-9910-beb16bd8b333 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:40.206600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 875/1793] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:40.379773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:40.412653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95158-6af4-464c-af48-019ae8b151cc service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:40.428603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:40.432007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:40.432671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:40.434857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:40.612188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:40.790028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:40.790691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:40.791236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:40.794995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:40.799734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15143e4c-7077-49bf-ac0c-5f20ed0983c5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:40.843312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] MFA Rules not processed for user `f534b7b5831d4dfc9da5641553c9f635`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:40.845115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 919/1794] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:40.847747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:41.030954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 876/1795] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:42.648557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:42.649085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:42.649395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:42.782359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:42.794309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:42.844122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 920/1796] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Sep 9 06:29:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:42.879722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:42.910504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917427-82ef-4baa-9b55-9280500107d1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:42.923794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:42.924499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:42.928555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:42.928962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:42.947073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:42.971232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:42.973978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503421a-6ad6-4177-979e-fd4076057786 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:43.021922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 877/1797] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:43.307598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:43.601305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc182e4-a3c9-4aaf-913c-8bc354ed2108 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:43.621316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:43.623106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:43.624998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:43.625273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] PATH_INFO: `/v3/users/cfe3a5d974eb48dd90497ec85598bf8c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:43.632398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe3a5d974eb48dd90497ec85598bf8c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:43.634564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:43.807475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe3a5d974eb48dd90497ec85598bf8c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:43.867588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe3a5d974eb48dd90497ec85598bf8c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:43.870278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe3a5d974eb48dd90497ec85598bf8c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:43.892845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe3a5d974eb48dd90497ec85598bf8c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:43.893807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe3a5d974eb48dd90497ec85598bf8c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:43.952766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 921/1798] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:43 2022] DELETE /identity/v3/users/cfe3a5d974eb48dd90497ec85598bf8c => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:43.954039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:43.954516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:43.954651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:44.009460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:44.012999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:44.318951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 878/1799] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:45.155458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:45.200599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:45.401865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:45.473934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932009e0-5111-40f0-a470-2a768b8c1ac9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:45.487527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:45.488439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:45.489078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:45.490078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:45.527679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:45.529592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:45.582483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 922/1800] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:48.402964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:48.405636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:48.420484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371cc56-69ef-47a0-902a-5f2797c70569 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:48.427667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:48.428780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:48.429269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:48.429768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] PATH_INFO: `/v3/users/f5384db48b164665ae46f9a5b7635fa9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:48.431405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5384db48b164665ae46f9a5b7635fa9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:48.434042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:48.616268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5384db48b164665ae46f9a5b7635fa9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.616268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5384db48b164665ae46f9a5b7635fa9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.619948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5384db48b164665ae46f9a5b7635fa9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.647026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5384db48b164665ae46f9a5b7635fa9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.670849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:48.672704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:48.702159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2c684acb-5723-44fb-8fb9-dcbf9eea333c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5384db48b164665ae46f9a5b7635fa9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.713060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330141aa-2d66-438c-b534-a87cb95bee9c service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:48.736101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:48.737283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:48.737858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:48.740339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] PATH_INFO: `/v3/projects/0acaac036d574437b189aab6533556b2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:48.751313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 879/1801] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:48 2022] DELETE /identity/v3/users/f5384db48b164665ae46f9a5b7635fa9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:48.753257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acaac036d574437b189aab6533556b2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:48.759718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:48.760192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:48.761028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:48.761753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:48.831535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:48.832911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:48.923887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acaac036d574437b189aab6533556b2', 'request_id': 'req-cc40a987-e6d4-4c92-b8a1-d70a805ced01'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.938786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acaac036d574437b189aab6533556b2', 'request_id': 'req-cc40a987-e6d4-4c92-b8a1-d70a805ced01'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:48.959521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acaac036d574437b189aab6533556b2', 'request_id': 'req-cc40a987-e6d4-4c92-b8a1-d70a805ced01'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.008235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] The token cache is being invalidate because project 0acaac036d574437b189aab6533556b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:49.008916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.010100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.015873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 923/1802] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:48 2022] DELETE /identity/v3/projects/0acaac036d574437b189aab6533556b2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:49.017051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:49.019068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:49.057899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 880/1803] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:49.108468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:49.110319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:49.133860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:49.219119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40a987-e6d4-4c92-b8a1-d70a805ced01 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:49.231373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:49.232735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:49.233352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:49.233612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] PATH_INFO: `/v3/users/47647f88298b4f27b559af9bf3ac1e28` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:49.235121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47647f88298b4f27b559af9bf3ac1e28)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:49.240225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:49.300947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b513e-2388-4aa3-9c3a-429d0cf6dd72 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:49.399508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47647f88298b4f27b559af9bf3ac1e28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.433418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:49.453222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47647f88298b4f27b559af9bf3ac1e28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.456175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47647f88298b4f27b559af9bf3ac1e28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.469437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:49.470124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:49.470622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:49.471056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:49.486711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47647f88298b4f27b559af9bf3ac1e28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.487960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-779b94d8-d9c4-488c-a3aa-debf483c8d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47647f88298b4f27b559af9bf3ac1e28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:49.521158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:49.523247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529501a-83b7-422f-9764-a0482888a3f6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:49.532480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 924/1804] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:49 2022] DELETE /identity/v3/users/47647f88298b4f27b559af9bf3ac1e28 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:49.547535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 881/1805] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:50.350823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:50.351781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:50.352559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:50.354509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 925/1806] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:29:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:29:50.703914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1472f-dfc7-4bf7-af12-a742f5ffb114 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:50.705479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1472f-dfc7-4bf7-af12-a742f5ffb114 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:50.706139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1472f-dfc7-4bf7-af12-a742f5ffb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:50.769242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8bc1472f-dfc7-4bf7-af12-a742f5ffb114 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:50.770514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8bc1472f-dfc7-4bf7-af12-a742f5ffb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:50.999589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 882/1807] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:29:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:51.269682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:51.274487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:51.428716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6779-b4eb-4fa6-9a55-d8a7179824f5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:51.429331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6779-b4eb-4fa6-9a55-d8a7179824f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:51.429812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6779-b4eb-4fa6-9a55-d8a7179824f5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:51.431398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 883/1808] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:29:51.500853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64eb0-41ce-4ebf-b11a-e4459ddded68 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:51.519890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:51.524626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:51.526054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:51.527342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] PATH_INFO: `/v3/projects/80e382c2180544ae97d1781f0ce777cb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:51.531449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e382c2180544ae97d1781f0ce777cb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:51.539103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:51.539550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:51.540448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:51.540975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:51.596291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:51.604254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:51.651876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 884/1809] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:29:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:51.659347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:51.665373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:51.737497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7cf26-515c-4c8c-8b89-dbf80759a6e4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:51.738136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e382c2180544ae97d1781f0ce777cb', 'request_id': 'req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:51.763163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e382c2180544ae97d1781f0ce777cb', 'request_id': 'req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:51.782415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e382c2180544ae97d1781f0ce777cb', 'request_id': 'req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:51.819838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] The token cache is being invalidate because project 80e382c2180544ae97d1781f0ce777cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:51.821175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:51.822980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:51.831770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 926/1810] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:51 2022] DELETE /identity/v3/projects/80e382c2180544ae97d1781f0ce777cb => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:51.831770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:51.835778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:51.851250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:51.895006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:51.896681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:51.896979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:51.897296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:51.899394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:51.924077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:51.929130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee06d3-0eb4-4c91-b407-1638a903c33b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:51.966780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 885/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:51.969728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c446-a57b-4c20-ba05-3ff44ff47a8c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:51.970019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c446-a57b-4c20-ba05-3ff44ff47a8c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:51.978556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c446-a57b-4c20-ba05-3ff44ff47a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.007502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd2d78-82d3-4247-be0c-a8296efb2d6c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:52.012858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:52.013655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.013944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.014219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] PATH_INFO: `/v3/projects/d40a5b7af3224644b02544be8af3b5a7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.015711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40a5b7af3224644b02544be8af3b5a7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:52.017873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:52.032150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:52.039567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0348c446-a57b-4c20-ba05-3ff44ff47a8c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:52.046108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0348c446-a57b-4c20-ba05-3ff44ff47a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.067330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 886/1812] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:52.075222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.075762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.076141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.109914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:52.117688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.143470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40a5b7af3224644b02544be8af3b5a7', 'request_id': 'req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.159978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40a5b7af3224644b02544be8af3b5a7', 'request_id': 'req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.180909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40a5b7af3224644b02544be8af3b5a7', 'request_id': 'req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.217717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] The token cache is being invalidate because project d40a5b7af3224644b02544be8af3b5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:52.222203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.227659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.235122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 927/1813] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:51 2022] DELETE /identity/v3/projects/d40a5b7af3224644b02544be8af3b5a7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:52.241011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:52.249132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.275043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 887/1814] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:29:52.276138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:52.283119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.306765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ab292-498a-45f9-8155-115a1b2c82e4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:52.325139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:52.326407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.326898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.327404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] PATH_INFO: `/v3/users/40a18f52855e4a569e370b8548e3f0fd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.329020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a18f52855e4a569e370b8548e3f0fd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:52.331892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:52.443552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a18f52855e4a569e370b8548e3f0fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.444665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a18f52855e4a569e370b8548e3f0fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.445534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a18f52855e4a569e370b8548e3f0fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.465200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a18f52855e4a569e370b8548e3f0fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.502732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a18f52855e4a569e370b8548e3f0fd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:52.515123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514d94-9129-4b0a-8f27-c8a6fb4bf103 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:52.522450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 888/1815] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:52 2022] DELETE /identity/v3/users/40a18f52855e4a569e370b8548e3f0fd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:52.523488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:52.527478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.530078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:52.549125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.549425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.549706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.557331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:52.602826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:52.606845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:52.646494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 928/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:52.669065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:52.734978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c764-4db4-4ef2-bcee-a43f7e3285d4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:52.748826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:52.751360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.751360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.751360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.751803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:52.752346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:52.759849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:52.798437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 889/1817] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:29:52.804333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:52.846463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d23e-9675-476f-8c4c-15059c2f9e1a service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:52.857996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:52.858865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:52.859386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:52.859785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:52.860715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:52.865941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:52.933860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 929/1818] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:52 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:52.934960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:52.959005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cccb-7852-4153-88cf-024179eec851 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.134804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.136452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.137240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.139010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.141096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.149298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.216385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 890/1819] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:52 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:53.220330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.248849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db196-94e6-4d64-b3d8-8485140cbac3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.265209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.269088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.269611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.270121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.271164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.280039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.319370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.321184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 930/1820] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:53.335179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc992-a9de-421e-a513-1ad29216e041 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.342665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.343451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.345664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.346529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.347328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.350070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ba2c9-42a9-4ea3-972c-06c8806a4aaa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.404346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 891/1821] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:53.405752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.425992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19adbee-78b1-46c2-8aaf-ee853e2d5e31 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.432472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.433312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.433679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.434021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] PATH_INFO: `/v3/projects/a8eb0afee3394fa997281c19ac4c21d6/users/be2880cbf60343fe9dd20e30eb0b3991/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.453626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eb0afee3394fa997281c19ac4c21d6, user_id=be2880cbf60343fe9dd20e30eb0b3991, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.456730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.474600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 931/1822] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:53 2022] PUT /identity/v3/projects/a8eb0afee3394fa997281c19ac4c21d6/users/be2880cbf60343fe9dd20e30eb0b3991/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:53.487228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.487228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.487228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.521631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] MFA Rules not processed for user `be2880cbf60343fe9dd20e30eb0b3991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:53.523106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:53.618639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.619827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 892/1823] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:53.664973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:53.716077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1a486-a553-48be-9596-429315ea558a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.729490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.730535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.732053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.732053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.732884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.744117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.786703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 932/1824] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:53 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:53.791569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.811134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1f99-614e-445c-a2e0-9daf396abaa6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.884816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:53.910643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.912243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.912752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.913029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.913697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.915656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.954755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 893/1825] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:53 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:29:53.958871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.975394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812be3-826e-4873-86d7-6144ca69ef5a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:53.980984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:53.981693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:53.981822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:53.982074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:53.982727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:53.984406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:53.989910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:53.991676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:53.999631 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 933/1826] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:54.007243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.027619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa9d07-07e1-43c5-afd0-b04097c8504d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.033441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b625-db2c-48eb-8cfd-b977cb3b7ef8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.040162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.040989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.041332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.041691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] PATH_INFO: `/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9/users/a83aa0e22a7149fd813ffcbb49ceb2cb/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.044840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.045695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.046138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.046583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] PATH_INFO: `/v3/projects/4486079ab5524bf1b6d4c19c01c22248` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.048764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4486079ab5524bf1b6d4c19c01c22248)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.051479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.066807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e607af8607a14d73ba5b54ab0a8c9ee9, user_id=a83aa0e22a7149fd813ffcbb49ceb2cb, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.070073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.100237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 934/1827] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:54 2022] PUT /identity/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9/users/a83aa0e22a7149fd813ffcbb49ceb2cb/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:54.104921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.160235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4486079ab5524bf1b6d4c19c01c22248', 'request_id': 'req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:54.181716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4486079ab5524bf1b6d4c19c01c22248', 'request_id': 'req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:54.194735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4486079ab5524bf1b6d4c19c01c22248', 'request_id': 'req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:54.219386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] The token cache is being invalidate because project 4486079ab5524bf1b6d4c19c01c22248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:29:54.221206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:54.223638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a43eee5a-2b21-4118-8e7d-1d8c41f2ec41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:54.225672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 894/1828] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:29:53 2022] DELETE /identity/v3/projects/4486079ab5524bf1b6d4c19c01c22248 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:54.230934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e332e-e61f-49bc-9eb1-9532bec276db None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.231352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e332e-e61f-49bc-9eb1-9532bec276db None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.231828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e332e-e61f-49bc-9eb1-9532bec276db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.241042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116c641-8f18-4dfd-a70f-9463ad956d9d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.275925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-488e332e-e61f-49bc-9eb1-9532bec276db None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:54.277978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-488e332e-e61f-49bc-9eb1-9532bec276db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:54.410167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.412469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.415427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.415895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.417379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.424492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.440926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 895/1829] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:54.443662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.443953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.444410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.459053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 935/1830] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:54.466640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.469079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:54.490729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e5af-8260-499a-ac55-713cf92a659c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.496612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:54.497869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:54.498610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.499525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.500040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.500389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] PATH_INFO: `/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9/users/a83aa0e22a7149fd813ffcbb49ceb2cb/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.505975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e607af8607a14d73ba5b54ab0a8c9ee9, user_id=a83aa0e22a7149fd813ffcbb49ceb2cb, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.514329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8470fd-9a0f-4919-869b-ecb7761e6145 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.520159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 896/1831] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:54.522900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.545971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c4eca-e7ff-4400-a724-18824793a320 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.572009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 936/1832] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:54 2022] PUT /identity/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9/users/a83aa0e22a7149fd813ffcbb49ceb2cb/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:29:54.584728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.584937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.585236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.615108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:54.627601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:54.647500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.650047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.650388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.650736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.651515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:29:54.651962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.654293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.675645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] MFA Rules not processed for user `a83aa0e22a7149fd813ffcbb49ceb2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:54.678275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:54.684614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 897/1833] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:29:54.688900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.711797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afc9a7-1f65-439d-9a55-ef7c979ed23c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.729883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.730545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.732349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.733198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.735252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:54.740360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:54.795618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 898/1834] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:54 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:54.799364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.870029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 937/1835] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:54.880841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:54.882420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:54.981624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaec4e-1e94-4e5e-8448-2ee130904506 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.993382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:54.994064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e635d-cb42-4068-996b-67d847371550 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:54.996181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:54.996741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:54.997719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:54.999319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.002728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.046440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 899/1836] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:54 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:55.058608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.076849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614d163-6006-407e-b5f1-44e24c73248a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.099590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.100468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.101087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.101688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.116797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.117083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.117235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.117573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.119259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:55.119864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.121530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.148501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 900/1837] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:55.150462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.167248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b1df7-d068-424e-a10a-7ffac11b6c14 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.173496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.174266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.174782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.175004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.176047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.181351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.202869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 901/1838] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:55.208302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.220732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92a784-bf0d-471d-915e-9eae97719672 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.228299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.229217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.229501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.229818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] PATH_INFO: `/v3/projects/c138ccf974744e28806fcd51e22f1b58/users/3ca20dd377744d538189ae88af7b67aa/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.244690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.246456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425d7c-abec-45bc-a354-e4735dc9c695 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.249434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c138ccf974744e28806fcd51e22f1b58, user_id=3ca20dd377744d538189ae88af7b67aa, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.253321 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.256276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 938/1839] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:29:55.269711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 902/1840] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:55 2022] PUT /identity/v3/projects/c138ccf974744e28806fcd51e22f1b58/users/3ca20dd377744d538189ae88af7b67aa/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:55.281113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.281405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.282473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.291211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:55.332008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] MFA Rules not processed for user `3ca20dd377744d538189ae88af7b67aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:55.333393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:55.398511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 939/1841] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:55.403618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.484862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625377c6-e1a1-43e4-8f27-968f0ea9f636 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.490689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.491311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.491722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.492000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.492684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.494922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.508643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:55.529415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 903/1842] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:29:55 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:55.533742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.554682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc76b4-3aec-4a2d-bf28-071423eb6a56 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.732310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.733177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.733667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.734005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.734824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.740348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.780630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 940/1843] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:29:55 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:29:55.787702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.800062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716b49-3a23-47dc-9d9d-998c4b8d39b8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.807345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.808138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.808529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.809055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.809788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.811924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.836805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.850649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 904/1844] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:55.853441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050a3d-46c4-4de7-abc1-5e5bd69599a0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:55.859953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:55.861154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:55.861276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:55.861868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] PATH_INFO: `/v3/projects/cb033de37fc047d1a87b9f2f4403e46c/users/18c33976b7774354b75aecc2ca9f52a8/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:55.882441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb033de37fc047d1a87b9f2f4403e46c, user_id=18c33976b7774354b75aecc2ca9f52a8, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:55.887170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:55.923698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 941/1845] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:55 2022] PUT /identity/v3/projects/cb033de37fc047d1a87b9f2f4403e46c/users/18c33976b7774354b75aecc2ca9f52a8/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:55.928657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:55.943149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5af8-aa3b-4823-a15d-fdf1883121f1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:56.039704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:56.040332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:56.040999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:56.040999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:56.044745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:56.046460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed2444-0ecc-4fcb-b910-08ee1ac1d8c4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:56.060671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 905/1846] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:29:56.062159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:56.078769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6bd44-10af-4351-ad82-e48b0a60d6b0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:56.087520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:56.088622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:56.088622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:56.088830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] PATH_INFO: `/v3/projects/cb033de37fc047d1a87b9f2f4403e46c/users/18c33976b7774354b75aecc2ca9f52a8/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:56.091446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb033de37fc047d1a87b9f2f4403e46c, user_id=18c33976b7774354b75aecc2ca9f52a8, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:56.094690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:56.109079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 942/1847] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:29:56 2022] PUT /identity/v3/projects/cb033de37fc047d1a87b9f2f4403e46c/users/18c33976b7774354b75aecc2ca9f52a8/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:56.121903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:56.122249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:56.122497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:56.197503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] MFA Rules not processed for user `18c33976b7774354b75aecc2ca9f52a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:56.202733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:56.361213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 906/1848] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:56.374191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:56.376495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:56.445306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:56.459325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e38b4-ff21-4415-b6df-4940bf5a5658 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:56.463979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:56.464627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:56.464945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:56.465369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:56.475420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:56.476918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc0e22-ebc1-47b6-867e-f235f04e132f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:56.488385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 943/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:58.206430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:58.282377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0355-5a2f-4e08-9f48-606d0594bad9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:58.289314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:58.290647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.290939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.291299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] PATH_INFO: `/v3/users/be2880cbf60343fe9dd20e30eb0b3991` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.292369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2880cbf60343fe9dd20e30eb0b3991)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:58.294660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:58.297364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:58.362052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2880cbf60343fe9dd20e30eb0b3991'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.363057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2880cbf60343fe9dd20e30eb0b3991'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.372175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2880cbf60343fe9dd20e30eb0b3991'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.383008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2880cbf60343fe9dd20e30eb0b3991'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.419682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2880cbf60343fe9dd20e30eb0b3991'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.436954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 907/1850] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:58 2022] DELETE /identity/v3/users/be2880cbf60343fe9dd20e30eb0b3991 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:58.440140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.440654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.441356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.446970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:58.450115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.474345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:58.478176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.537898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f970-a08e-4ab7-ba02-39518cf31055 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:58.544236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:58.544971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.545249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.545545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] PATH_INFO: `/v3/users/3ca20dd377744d538189ae88af7b67aa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.546763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca20dd377744d538189ae88af7b67aa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:58.549420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:58.571376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 944/1851] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:58.572398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:58.573784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.621799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a6463-106b-4beb-bd2b-6b92f9f35927 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:58.629758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca20dd377744d538189ae88af7b67aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.630356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca20dd377744d538189ae88af7b67aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.631041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca20dd377744d538189ae88af7b67aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.632474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:58.633955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.634214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.635308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] PATH_INFO: `/v3/users/123e8be64beb46dfb5fe751628a4a3c5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.637020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=123e8be64beb46dfb5fe751628a4a3c5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:58.639693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca20dd377744d538189ae88af7b67aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.640546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:58.681703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca20dd377744d538189ae88af7b67aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.693935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:58.699978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 908/1852] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:58 2022] DELETE /identity/v3/users/3ca20dd377744d538189ae88af7b67aa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:58.701342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:58.704066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.734087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123e8be64beb46dfb5fe751628a4a3c5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.752842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123e8be64beb46dfb5fe751628a4a3c5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.753655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123e8be64beb46dfb5fe751628a4a3c5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.763466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123e8be64beb46dfb5fe751628a4a3c5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.764222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6ed80ef5-1556-4731-ab3f-72fe0312e9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123e8be64beb46dfb5fe751628a4a3c5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:29:58.796337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 945/1853] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:29:58 2022] DELETE /identity/v3/users/123e8be64beb46dfb5fe751628a4a3c5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:29:58.800639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01225db-d448-4eb3-8bec-c5ceb754d3fd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.800931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01225db-d448-4eb3-8bec-c5ceb754d3fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.801209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01225db-d448-4eb3-8bec-c5ceb754d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.812453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212a4d-52a5-4240-b4a2-c482cc8b6755 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:58.835517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d01225db-d448-4eb3-8bec-c5ceb754d3fd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:58.836906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d01225db-d448-4eb3-8bec-c5ceb754d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.893217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:58.894007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.894141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.894358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.898315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.902002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:58.920222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 946/1854] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:58.922108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:58.922581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:58.923175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:58.956846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:29:58.960388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.979484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 947/1855] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:29:58.982230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:58.982871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:58.983656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:29:58.984334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:58.996163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 909/1856] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:58.997854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:29:59.001468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50194a23-74d8-4beb-818f-b9c0621899d4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:59.006895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:59.007445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:59.007730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:59.008009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:59.008601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d0ad-e787-490e-bf63-b0f0582c87f4 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:29:59.012869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:29:59.013693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:29:59.014093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:29:59.014319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:29:59.020093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:59.022225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:59.026346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:29:59.028029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:29:59.035434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 948/1857] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:29:59.039628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 910/1858] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:00.026884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.029381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.048890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b92f7-04db-430a-bf5b-83138bca85aa service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.055900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.057090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.057357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.057632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] PATH_INFO: `/v3/projects/a8eb0afee3394fa997281c19ac4c21d6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.059233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8eb0afee3394fa997281c19ac4c21d6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.061974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.071346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.073398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.091060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1ddd-9322-4822-ba4c-d13788e3eb5d service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.097101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.100629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.103781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.104080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] PATH_INFO: `/v3/projects/3f7413139dad4ee0bba7a1e99a283c20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.106592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7413139dad4ee0bba7a1e99a283c20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.111187 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.152665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8eb0afee3394fa997281c19ac4c21d6', 'request_id': 'req-d0e9aeda-64ed-48b9-8050-112d116da2ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.159245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8eb0afee3394fa997281c19ac4c21d6', 'request_id': 'req-d0e9aeda-64ed-48b9-8050-112d116da2ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.180698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8eb0afee3394fa997281c19ac4c21d6', 'request_id': 'req-d0e9aeda-64ed-48b9-8050-112d116da2ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.197786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:00.199706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7413139dad4ee0bba7a1e99a283c20', 'request_id': 'req-13f8be23-e0d2-4a63-9443-21a9528ee0c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.210452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7413139dad4ee0bba7a1e99a283c20', 'request_id': 'req-13f8be23-e0d2-4a63-9443-21a9528ee0c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.219916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] The token cache is being invalidate because project a8eb0afee3394fa997281c19ac4c21d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:00.220219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.221244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7413139dad4ee0bba7a1e99a283c20', 'request_id': 'req-13f8be23-e0d2-4a63-9443-21a9528ee0c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.221455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.227816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 949/1859] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/projects/a8eb0afee3394fa997281c19ac4c21d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.228701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.230358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.239999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] The token cache is being invalidate because project 3f7413139dad4ee0bba7a1e99a283c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:00.240745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.241789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.244768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 911/1860] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/projects/3f7413139dad4ee0bba7a1e99a283c20 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.246002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.247886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.309638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9aeda-64ed-48b9-8050-112d116da2ee admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.334580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8be23-e0d2-4a63-9443-21a9528ee0c6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.340905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.342216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.342216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.342216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] PATH_INFO: `/v3/users/a83aa0e22a7149fd813ffcbb49ceb2cb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.343316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83aa0e22a7149fd813ffcbb49ceb2cb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.346920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.394441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.395079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.400041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.400041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] PATH_INFO: `/v3/projects/c138ccf974744e28806fcd51e22f1b58` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.400041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c138ccf974744e28806fcd51e22f1b58)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.400041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.414728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:00.419037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83aa0e22a7149fd813ffcbb49ceb2cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.419818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83aa0e22a7149fd813ffcbb49ceb2cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.420533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83aa0e22a7149fd813ffcbb49ceb2cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.428895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83aa0e22a7149fd813ffcbb49ceb2cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.447500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83aa0e22a7149fd813ffcbb49ceb2cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.463331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 912/1861] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/users/a83aa0e22a7149fd813ffcbb49ceb2cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.464145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.465566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.478847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c138ccf974744e28806fcd51e22f1b58', 'request_id': 'req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.489688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c138ccf974744e28806fcd51e22f1b58', 'request_id': 'req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.505354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c138ccf974744e28806fcd51e22f1b58', 'request_id': 'req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.532595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] The token cache is being invalidate because project c138ccf974744e28806fcd51e22f1b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:00.532998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.534677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-db6c38d7-8f71-4757-85f6-d0d2e3b05ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.540248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 950/1862] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/projects/c138ccf974744e28806fcd51e22f1b58 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.542886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.543190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.543480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.546271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 951/1863] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:30:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:30:00.547951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.551044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:00.551228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.558963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde922c-3a5e-4d15-96c2-2a8b7ad81966 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.569703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.570615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.571423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.571876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] PATH_INFO: `/v3/users/f7e070d3e90b42619559780bdf3a139b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.573607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e070d3e90b42619559780bdf3a139b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.575928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.581693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f3d54-5089-438e-ad94-6f3f86f51a14 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:00.588264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:00.589675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.590313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.590538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] PATH_INFO: `/v3/users/18c33976b7774354b75aecc2ca9f52a8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.591810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c33976b7774354b75aecc2ca9f52a8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:00.603325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:00.657514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e070d3e90b42619559780bdf3a139b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.658487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e070d3e90b42619559780bdf3a139b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.659164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e070d3e90b42619559780bdf3a139b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.670628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e070d3e90b42619559780bdf3a139b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.708870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be4ef45f-9f08-428f-8ad1-b164efcf522c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e070d3e90b42619559780bdf3a139b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.726856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c33976b7774354b75aecc2ca9f52a8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.737516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 913/1864] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/users/f7e070d3e90b42619559780bdf3a139b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.744007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:00.744308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:00.744604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:00.760262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c33976b7774354b75aecc2ca9f52a8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.764894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c33976b7774354b75aecc2ca9f52a8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.786243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c33976b7774354b75aecc2ca9f52a8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.788108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c33976b7774354b75aecc2ca9f52a8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:00.794555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:00.796281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:00.809675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 952/1865] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:00 2022] DELETE /identity/v3/users/18c33976b7774354b75aecc2ca9f52a8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:00.950379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 914/1866] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:30:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:00.982567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:00.983385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.022301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:01.023866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.172318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186140c-1b71-4e3b-a315-3513f711f61a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:01.183528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:01.184359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.184795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.185131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.215231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5745d-39b2-48e7-9e9b-ede11fea4484 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:01.217755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:01.221748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a591f98-bcd4-4f7f-b722-32b86cf2a7bb service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:01.232654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:01.242667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:01.258195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 953/1867] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:01.358045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:01.359110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.359110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.359312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] PATH_INFO: `/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.361934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e607af8607a14d73ba5b54ab0a8c9ee9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:01.363953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:01.467172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e607af8607a14d73ba5b54ab0a8c9ee9', 'request_id': 'req-3a08eca6-d6c2-4821-9f08-98015886c89a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.481832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e607af8607a14d73ba5b54ab0a8c9ee9', 'request_id': 'req-3a08eca6-d6c2-4821-9f08-98015886c89a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.495993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e607af8607a14d73ba5b54ab0a8c9ee9', 'request_id': 'req-3a08eca6-d6c2-4821-9f08-98015886c89a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.518292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] The token cache is being invalidate because project e607af8607a14d73ba5b54ab0a8c9ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:01.518596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.519382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.525869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 915/1868] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:01 2022] DELETE /identity/v3/projects/e607af8607a14d73ba5b54ab0a8c9ee9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:01.527362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac09d1-573b-4984-b9f9-ccaccf8fb750 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.528170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac09d1-573b-4984-b9f9-ccaccf8fb750 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.528170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac09d1-573b-4984-b9f9-ccaccf8fb750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.562299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b0ac09d1-573b-4984-b9f9-ccaccf8fb750 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:01.564665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b0ac09d1-573b-4984-b9f9-ccaccf8fb750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.647372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:01.648963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.674372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 954/1869] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:01.682643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.685079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.685721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.715396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:01.719105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.777931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08eca6-d6c2-4821-9f08-98015886c89a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:01.788821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:01.789662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.789817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 955/1870] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:01.790129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.790973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] PATH_INFO: `/v3/projects/8cace49f129448e9941c6932e6ffd7b4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.792304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:01.792437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cace49f129448e9941c6932e6ffd7b4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:01.795242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.795756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:01.817785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f499-6071-48d0-9a7a-66c6e6a429e9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:01.823254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:01.823899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.824602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.824897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] PATH_INFO: `/v3/projects/cb033de37fc047d1a87b9f2f4403e46c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.827152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb033de37fc047d1a87b9f2f4403e46c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:01.829468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:01.868709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:01.875751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cace49f129448e9941c6932e6ffd7b4', 'request_id': 'req-b713c08d-c56d-4478-8f9a-102adfe7bd17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.885294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cace49f129448e9941c6932e6ffd7b4', 'request_id': 'req-b713c08d-c56d-4478-8f9a-102adfe7bd17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.895043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cace49f129448e9941c6932e6ffd7b4', 'request_id': 'req-b713c08d-c56d-4478-8f9a-102adfe7bd17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.902576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb033de37fc047d1a87b9f2f4403e46c', 'request_id': 'req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.914195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] The token cache is being invalidate because project 8cace49f129448e9941c6932e6ffd7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:01.914195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.914533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb033de37fc047d1a87b9f2f4403e46c', 'request_id': 'req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.915828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.919731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 916/1871] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:01 2022] DELETE /identity/v3/projects/8cace49f129448e9941c6932e6ffd7b4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:01.923336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:01.923336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:01.926363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb033de37fc047d1a87b9f2f4403e46c', 'request_id': 'req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.940965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] The token cache is being invalidate because project cb033de37fc047d1a87b9f2f4403e46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:01.941268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.942231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0406ed86-3fb6-4c5d-8eed-5ea0d8505122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:01.947432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 956/1872] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:01 2022] DELETE /identity/v3/projects/cb033de37fc047d1a87b9f2f4403e46c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:01.947432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56de9e-213c-4dfc-9b43-8b0b1a59b1a1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:01.947432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56de9e-213c-4dfc-9b43-8b0b1a59b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:01.947432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56de9e-213c-4dfc-9b43-8b0b1a59b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:01.971999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-da56de9e-213c-4dfc-9b43-8b0b1a59b1a1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:01.973891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da56de9e-213c-4dfc-9b43-8b0b1a59b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:02.004987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713c08d-c56d-4478-8f9a-102adfe7bd17 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.068990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 957/1873] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:02.071227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.071520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.071794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.099486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.100340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.100812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.101093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.101764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:02.102072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.103975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c7af-ec03-4f78-8ba5-4024a8f983a1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.111690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:02.113418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:02.119394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 917/1874] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:02.120817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdebc1-fa26-4660-8de0-d658610974e0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.121112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdebc1-fa26-4660-8de0-d658610974e0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.121397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdebc1-fa26-4660-8de0-d658610974e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.125230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 958/1875] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:02.126663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.128916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:02.150216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f6fdebc1-fa26-4660-8de0-d658610974e0 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:02.151399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f6fdebc1-fa26-4660-8de0-d658610974e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:02.155642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e167a7-3372-413f-bb35-efbe53009f5f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.167443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 918/1876] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:02.167639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.167639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.167639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.167639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.169367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.169367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.169732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.170483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.174231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.186107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:02.219922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:02.222857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:02.240224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 959/1877] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.241330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.248892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 919/1878] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:02.250142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.267641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6127ba1-aa82-45aa-a40e-e6163874b67f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.329581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035593a-63b5-475b-b914-fd7574f95d6b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.336870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.337633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.338033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.338328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.338992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:02.339357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.341140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.364863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 960/1879] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:02.368632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.393650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37fe3-c657-4569-a79a-a4e0e7304288 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.395090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.396340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.396767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.398737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.399306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.402183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.402741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.403580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.404005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.404422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.405317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:02.405864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.407916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.413843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:02.428766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 961/1880] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:02.431000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.438195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 920/1881] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.438195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.445831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b206-8dae-4b0d-ab30-9d70269ec364 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.451517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52107d-2e9b-4328-87f3-3ebfb306f0eb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.451783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.452504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.453401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.453401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.454207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.456168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.456944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.457674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.458565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.458925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.459646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.464427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.498625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 962/1882] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.498625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.515269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 921/1883] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.515269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.575951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d88f94-d52c-444c-9568-b76518f0e760 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.610714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c4916-394f-4c6d-bfe9-df247c0594fb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.617239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.617875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.618662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.619038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.619771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.626992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.663068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:02.679482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 922/1884] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.680201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.693486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.694553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.694843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.695122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.705324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.709926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8bb2-0a19-4f81-bd7d-80fbd4746a4d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.710711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.721895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.722448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.722736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.723013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.723706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.725698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.726003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 963/1885] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:02.726681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.741365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf88f02-d570-40cb-abd7-7cc43b2b8a6a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.746511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.747429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.747717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.748130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.749025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.750761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.770755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 964/1886] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:02.771732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.788556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 923/1887] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:02 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:02.789491 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.801151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c8be3-8660-4e5b-962f-43fdc2f0e4fa admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.803063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024197c4-b3a1-4e8c-8fdd-8fe6c3a90d36 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.809197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.810263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.810447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.811016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.811968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.812637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.812930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.813247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.813869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.813977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.815507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.817156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.838353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 924/1888] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:02.844528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.852223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 965/1889] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:02.853627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.866159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe27f-9dcc-48ee-9372-553dc3ed5964 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.869457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021a279-732f-495c-86bc-d461091c78e2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:02.872058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.873307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.873778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.874227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] PATH_INFO: `/v3/projects/4ba6df863d654ba3acd9427e1b18d322/users/996e7d8164b249db8ac220aa4ca92ef5/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.883427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:02.884182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:02.884374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:02.884726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:02.885671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.887927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.906681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba6df863d654ba3acd9427e1b18d322, user_id=996e7d8164b249db8ac220aa4ca92ef5, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:02.912415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:02.915178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 925/1890] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:02.920204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.943109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 966/1891] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:02 2022] PUT /identity/v3/projects/4ba6df863d654ba3acd9427e1b18d322/users/996e7d8164b249db8ac220aa4ca92ef5/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:02.944718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:02.975977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b39de-9ae8-4c89-ae70-ccf2b45644f2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.037983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9761a66-0bab-4aa6-aacf-55b6c273b4d9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.045039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.045640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.045923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.046201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.047618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.048514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3b82e-0f46-4635-979a-729d80189897 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.059625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 967/1892] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:03.065170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533fab6-9e6d-4b7f-9458-5523c4ebad24 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.065475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533fab6-9e6d-4b7f-9458-5523c4ebad24 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.065758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533fab6-9e6d-4b7f-9458-5523c4ebad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.088742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.089656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.089945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.090680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] PATH_INFO: `/v3/projects/f337e4081bb74f19b07dd0a59ab50e71/users/4bbea3a8c41f42a797d8688dff0e59ee/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.107111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7533fab6-9e6d-4b7f-9458-5523c4ebad24 None None] MFA Rules not processed for user `996e7d8164b249db8ac220aa4ca92ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:03.108382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7533fab6-9e6d-4b7f-9458-5523c4ebad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:03.108531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f337e4081bb74f19b07dd0a59ab50e71, user_id=4bbea3a8c41f42a797d8688dff0e59ee, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.111666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.137360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 926/1893] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:02 2022] PUT /identity/v3/projects/f337e4081bb74f19b07dd0a59ab50e71/users/4bbea3a8c41f42a797d8688dff0e59ee/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:03.137360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.143224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:03.207387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 968/1894] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:03.207387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bbc5-8a09-4466-8555-126c20bd5cae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.207387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bbc5-8a09-4466-8555-126c20bd5cae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.207387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bbc5-8a09-4466-8555-126c20bd5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.235776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddda8d8-2738-4212-84e7-bdfc08382cf9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.241337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.242408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.242865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.242979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e598bbc5-8a09-4466-8555-126c20bd5cae None None] MFA Rules not processed for user `4bbea3a8c41f42a797d8688dff0e59ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:03.243139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] PATH_INFO: `/v3/projects/460ce73eec1e4112b786cb887cc70496/users/9b0e72896300464ca23d4a0b98964d02/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.244185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e598bbc5-8a09-4466-8555-126c20bd5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:03.262209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ce73eec1e4112b786cb887cc70496, user_id=9b0e72896300464ca23d4a0b98964d02, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.264881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:03.266195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.287157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 927/1895] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:03 2022] PUT /identity/v3/projects/460ce73eec1e4112b786cb887cc70496/users/9b0e72896300464ca23d4a0b98964d02/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:03.287790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.289558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:03.343785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 969/1896] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:03.346087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.346374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.346784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.373795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560db0c-4530-4f1c-9061-2938b569c15d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.379461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.380535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.380984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.381359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.432377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] MFA Rules not processed for user `9b0e72896300464ca23d4a0b98964d02`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:03.443880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:03.507096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.515008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.537668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 928/1897] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:03.538494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.540971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:03.573906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 970/1898] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:03.580322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.635021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:03.722856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d74a07-ef12-4d08-a474-0101ee173f23 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.729002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.729544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.729828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.730106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.754012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d84bcf-56bc-48aa-af0c-f83aef4a186c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.767520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.768865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.769338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.769684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.770742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.773166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.804555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.808310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 971/1899] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:03 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:03.808431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.809602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.816623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 929/1900] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:03.859720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:03.889887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8964e-def7-49cb-aab0-fa789355c379 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.896082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.897123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.897957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.898377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.899020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.902081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.928700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 972/1901] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:03 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:03.930093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.946290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d04f3c-ba58-44bb-a691-b76169b8a147 service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.952300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.953222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.953818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.954290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:03.955413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:03.958304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:03.972277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 930/1902] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:03.976356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:03.990000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f49b-e8c3-4901-8468-b499b5e0d80b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:03.995049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:03.995727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:03.996010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:03.996285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] PATH_INFO: `/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4/users/65f8ad82ffb440c78b852d60d82a9800/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.035246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6f7c8bf3e47b7ab53f5f253390ef4, user_id=65f8ad82ffb440c78b852d60d82a9800, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:04.038203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:04.061425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 973/1903] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:03 2022] PUT /identity/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4/users/65f8ad82ffb440c78b852d60d82a9800/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:04.065258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:04.075422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5ddc9-d48d-4559-8465-99605b73426f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:04.197990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:04.198799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:04.199090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:04.199384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.200197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:04.201843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8ca64-84d1-4940-8c43-97658a37fbe9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:04.213922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 931/1904] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:04.218780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:04.232943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce23f1-64e4-455d-9bfb-7822d81270e7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:04.239854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:04.240606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:04.240915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:04.241196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] PATH_INFO: `/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4/users/65f8ad82ffb440c78b852d60d82a9800/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.243295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6f7c8bf3e47b7ab53f5f253390ef4, user_id=65f8ad82ffb440c78b852d60d82a9800, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:04.247231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:04.268621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 974/1905] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:04 2022] PUT /identity/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4/users/65f8ad82ffb440c78b852d60d82a9800/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:04.274707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:04.275174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:04.275250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.330305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] MFA Rules not processed for user `65f8ad82ffb440c78b852d60d82a9800`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:04.331772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:04.426550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:04.462121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 932/1906] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:04.516289 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:04.606963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec935-482a-4c0a-8cb6-dff6f34b135c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:04.612157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:04.612911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:04.613260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:04.613814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.626809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:04.628242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfc3b1-0413-466b-9b81-84bce1566f01 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:04.647194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 975/1907] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:04.829495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:04.914264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67205-bb62-4199-93b6-8cbc71171909 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:04.920710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:04.923470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:04.923470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:04.923470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] PATH_INFO: `/v3/users/9b0e72896300464ca23d4a0b98964d02` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:04.924834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0e72896300464ca23d4a0b98964d02)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:04.928033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:04.992307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0e72896300464ca23d4a0b98964d02'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:04.993268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0e72896300464ca23d4a0b98964d02'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:04.994745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0e72896300464ca23d4a0b98964d02'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.004777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0e72896300464ca23d4a0b98964d02'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.018843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0e72896300464ca23d4a0b98964d02'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.048702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 933/1908] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:04 2022] DELETE /identity/v3/users/9b0e72896300464ca23d4a0b98964d02 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:05.050741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:05.051032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:05.051476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:05.073348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:05.074668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:05.184630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 976/1909] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:05.196134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:05.197637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:05.274675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12ed7d-47e3-4088-ba4a-3875193b6bbe admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:05.279472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:05.280128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:05.280395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:05.280696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:05.292386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:05.293957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:05.305878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 934/1910] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:05.758169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:05.761545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:05.783598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e7587-d651-4c93-962d-5cb70f5729a0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:05.790865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:05.791517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:05.791805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:05.792076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] PATH_INFO: `/v3/projects/460ce73eec1e4112b786cb887cc70496` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:05.793769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460ce73eec1e4112b786cb887cc70496)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:05.796486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:05.867470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:05.906670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460ce73eec1e4112b786cb887cc70496', 'request_id': 'req-a0e09a23-b698-4f59-aba0-c83671cb12c4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.918123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460ce73eec1e4112b786cb887cc70496', 'request_id': 'req-a0e09a23-b698-4f59-aba0-c83671cb12c4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.942420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460ce73eec1e4112b786cb887cc70496', 'request_id': 'req-a0e09a23-b698-4f59-aba0-c83671cb12c4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.971643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] The token cache is being invalidate because project 460ce73eec1e4112b786cb887cc70496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:05.971643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.971643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:05.971643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 977/1911] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:05 2022] DELETE /identity/v3/projects/460ce73eec1e4112b786cb887cc70496 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:05.972382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:05.990987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3884e08-41a3-47aa-a9b1-86ae552757c0 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:06.007653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:06.095715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:06.096348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:06.096663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:06.096938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] PATH_INFO: `/v3/users/65f8ad82ffb440c78b852d60d82a9800` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:06.098169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f8ad82ffb440c78b852d60d82a9800)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:06.100371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:06.164430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f8ad82ffb440c78b852d60d82a9800'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.165212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f8ad82ffb440c78b852d60d82a9800'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.165919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f8ad82ffb440c78b852d60d82a9800'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.188161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f8ad82ffb440c78b852d60d82a9800'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.208861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bbc6f872-ec43-4d57-859d-5d5f87fc9187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f8ad82ffb440c78b852d60d82a9800'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.232695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 935/1912] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:05 2022] DELETE /identity/v3/users/65f8ad82ffb440c78b852d60d82a9800 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:06.634288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:06.636768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:06.669096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a23-b698-4f59-aba0-c83671cb12c4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:06.772859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:06.774420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:06.775676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:06.775963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] PATH_INFO: `/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:06.779674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa6f7c8bf3e47b7ab53f5f253390ef4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:06.781711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:06.873419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa6f7c8bf3e47b7ab53f5f253390ef4', 'request_id': 'req-2ff962f2-f430-447a-8af3-e38051e64741'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.887954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa6f7c8bf3e47b7ab53f5f253390ef4', 'request_id': 'req-2ff962f2-f430-447a-8af3-e38051e64741'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.909329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa6f7c8bf3e47b7ab53f5f253390ef4', 'request_id': 'req-2ff962f2-f430-447a-8af3-e38051e64741'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.928220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] The token cache is being invalidate because project 3fa6f7c8bf3e47b7ab53f5f253390ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:06.928634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.932087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2ff962f2-f430-447a-8af3-e38051e64741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:06.938909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 978/1913] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:06 2022] DELETE /identity/v3/projects/3fa6f7c8bf3e47b7ab53f5f253390ef4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:06.942138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:06.942819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:06.942819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:06.993482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:06.994874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:07.099266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 936/1914] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:07.107194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.107482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.107762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.145981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:07.148092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:07.164180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 979/1915] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:07.168382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.181978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db01d8-12d1-4871-a28c-c1750311cd22 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.199669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.200950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.201254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.201550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.202190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:07.202495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.204478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.229068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.234657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 937/1916] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:07.239236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a5817-76aa-4eb9-b200-3cdbbe6aed28 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.246269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.250331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.250656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.250912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.251603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.253567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.304425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 980/1917] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:07 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:07.308709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.338181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d52c6-abc0-4787-b3f4-b6b2f56260b4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.361813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:07.469935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.470566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.471081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.471364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.472226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.475246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.541924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.542434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 938/1918] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:07 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:07.565323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c20d6-6ff0-4a11-ae53-e5d082057da1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.598569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.599224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.599649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.599916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.600659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.602227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.639373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 981/1919] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:07.643362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.665828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a185-5517-44e2-853d-876ec9c8c2de admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.685919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.687066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.690604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.692930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.695541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.700125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670694f8-a550-4a27-8f71-aba0e0c95c41 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.760660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 939/1920] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:07.763847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:07.774014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:07.784887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29e88d-95a0-4ee8-be1d-a6cc8b0b9349 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:07.807531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:07.809891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.811115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.812211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] PATH_INFO: `/v3/projects/678e0081c7914773ac51742ab1dae1c9/users/1ab49e4cd4a64ab7b1402b86242d1ce1/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.849769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678e0081c7914773ac51742ab1dae1c9, user_id=1ab49e4cd4a64ab7b1402b86242d1ce1, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:07.854298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:07.893063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 982/1921] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:07 2022] PUT /identity/v3/projects/678e0081c7914773ac51742ab1dae1c9/users/1ab49e4cd4a64ab7b1402b86242d1ce1/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:07.905381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:07.905709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:07.906090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:07.962794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] MFA Rules not processed for user `1ab49e4cd4a64ab7b1402b86242d1ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:07.964255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:08.217803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 940/1922] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:08.222926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.358987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078a34b-9e1d-450b-ae71-d2eb4252dc97 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.365242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.365936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.366333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.366610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.367473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.369614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.408623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 983/1923] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:08 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:08.412820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.435914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33c19-3660-4d4f-87f1-98cf59da248c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.502883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698248-c123-46d3-987f-274194c61272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.503509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698248-c123-46d3-987f-274194c61272 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.503795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698248-c123-46d3-987f-274194c61272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.504072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698248-c123-46d3-987f-274194c61272 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.504817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698248-c123-46d3-987f-274194c61272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.506736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698248-c123-46d3-987f-274194c61272 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.530050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 941/1924] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:08 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:08.535344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.547079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541303e-14f1-419e-aec6-3887b94fbe02 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.552382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.553104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.553528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.553812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.554534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.556183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.572452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 984/1925] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:08.574183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698248-c123-46d3-987f-274194c61272 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.585387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698248-c123-46d3-987f-274194c61272 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.590522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.591228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.591514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.591792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] PATH_INFO: `/v3/projects/c43d8c3820f448239c2175ceaf8f103a/users/afb2a05942284a709d0f5830526deb84/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.604451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:08.615929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43d8c3820f448239c2175ceaf8f103a, user_id=afb2a05942284a709d0f5830526deb84, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.618845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.647492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 942/1926] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:08 2022] PUT /identity/v3/projects/c43d8c3820f448239c2175ceaf8f103a/users/afb2a05942284a709d0f5830526deb84/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:08.650125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.660497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d236eb-f5e7-4c7d-bfb4-813f590a88b9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.745534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.746524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.746923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.747305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.750488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.752195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36082d4-eea9-47d8-adfe-7d4ae43cef49 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.769193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 985/1927] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:08.773350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.786697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23461d-30b5-4cd0-99d9-3e0c19d46874 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:08.792124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:08.792968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.793790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.794661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] PATH_INFO: `/v3/projects/c43d8c3820f448239c2175ceaf8f103a/users/afb2a05942284a709d0f5830526deb84/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.796269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43d8c3820f448239c2175ceaf8f103a, user_id=afb2a05942284a709d0f5830526deb84, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:08.799308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:08.812479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 943/1928] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:08 2022] PUT /identity/v3/projects/c43d8c3820f448239c2175ceaf8f103a/users/afb2a05942284a709d0f5830526deb84/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:08.824448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082118-9449-4119-8917-00375c6e09fc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:08.825138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082118-9449-4119-8917-00375c6e09fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:08.825138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082118-9449-4119-8917-00375c6e09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:08.863197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-60082118-9449-4119-8917-00375c6e09fc None None] MFA Rules not processed for user `afb2a05942284a709d0f5830526deb84`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:08.864871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-60082118-9449-4119-8917-00375c6e09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:08.928102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:08.977915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 986/1929] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:08.985422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:08.987279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:09.075205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1452a90-83f1-4855-ad45-09fc7ae79519 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:09.079012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:09.079702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:09.080014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:09.080291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:09.092702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:09.094275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:09.108133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 944/1930] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:09.200780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60082118-9449-4119-8917-00375c6e09fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:09.211217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60082118-9449-4119-8917-00375c6e09fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:09.216807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:09.217428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:09.217712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:09.218012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:09.285504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:09.287135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e962c7-7d3b-4cc3-8649-83f5557f631e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:09.296973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 987/1931] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:10.791743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:10.793246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:10.901418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cabd77-1d88-427f-ad17-54dc89949cd1 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:10.914958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:10.915776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:10.916163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:10.916745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] PATH_INFO: `/v3/users/996e7d8164b249db8ac220aa4ca92ef5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:10.919705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=996e7d8164b249db8ac220aa4ca92ef5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:10.921750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:11.033758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996e7d8164b249db8ac220aa4ca92ef5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.035156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996e7d8164b249db8ac220aa4ca92ef5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.036877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996e7d8164b249db8ac220aa4ca92ef5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.053593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996e7d8164b249db8ac220aa4ca92ef5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.074097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996e7d8164b249db8ac220aa4ca92ef5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.079410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:11.094181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 945/1932] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:10 2022] DELETE /identity/v3/users/996e7d8164b249db8ac220aa4ca92ef5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:11.099155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:11.099660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:11.099738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:11.120307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:11.121995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:11.209180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 988/1933] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:11.222758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:11.225064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:11.338613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dbd85-1267-4d95-ab3f-dbb41969a94b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:11.343883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:11.344194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:11.344551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:11.344928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:11.356497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:11.358329 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447713e0-a0cf-4617-9940-597b8d6fd5bf service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:11.371560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 946/1934] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:11.891773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:11.893368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:11.906066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921577-9f05-46fb-9a27-7ffc9382fd9e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:11.913560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:11.914217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:11.914500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:11.914776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] PATH_INFO: `/v3/projects/4ba6df863d654ba3acd9427e1b18d322` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:11.915992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba6df863d654ba3acd9427e1b18d322)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:11.917929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:11.972786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba6df863d654ba3acd9427e1b18d322', 'request_id': 'req-67951d24-04d0-428b-90c6-a6956471c95c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.982939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba6df863d654ba3acd9427e1b18d322', 'request_id': 'req-67951d24-04d0-428b-90c6-a6956471c95c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.991484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba6df863d654ba3acd9427e1b18d322', 'request_id': 'req-67951d24-04d0-428b-90c6-a6956471c95c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:11.994600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:12.009854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] The token cache is being invalidate because project 4ba6df863d654ba3acd9427e1b18d322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:12.010261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:12.010979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67951d24-04d0-428b-90c6-a6956471c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:12.012752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 989/1935] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:11 2022] DELETE /identity/v3/projects/4ba6df863d654ba3acd9427e1b18d322 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:12.020882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.021382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.021697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.045100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:12.046395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:12.138597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 947/1936] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:12.143845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.144310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.144433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.164619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:12.165924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:12.178168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 990/1937] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:12.182386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.196265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a48d-2846-45d8-bf29-7309d1bda614 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.201344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.201966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.202244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.202515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.203256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:12.203451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.206675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.231913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 948/1938] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:12.233732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.247732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5c41-8811-41b6-bf56-a89f1a5b07ec None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.254982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.255867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.256317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.256954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.261872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.268264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.341646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 991/1939] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:12 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:12.346334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.362656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df83a-30df-4f97-abba-726d5657cd2f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.451051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.453039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.454930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.455375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.456464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.464830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.521719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 949/1940] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:12 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:12.526124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.558765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92ba17-be03-4e3a-a2ef-6b9487bd143e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.581177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.581818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.582107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.587491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.588288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.593130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.621543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 992/1941] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:12.625337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.664138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c9de9-6f9d-411c-bd16-3a1c0f28b7fc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.689393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.690302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.691236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.695441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.696158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.699494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899ebe-4d80-4917-9a24-02b3efdafe6d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.738490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 950/1942] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:12.743172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:12.761871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e095fa-b2b2-481f-9b9c-71a2570f3d57 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:12.787821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:12.790928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.790928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.796796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] PATH_INFO: `/v3/projects/2eb0d30313164a74ae7e3e4c8970e7ba/users/4cd89e58b97f4eb6a7a35655493d3aa9/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.830349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb0d30313164a74ae7e3e4c8970e7ba, user_id=4cd89e58b97f4eb6a7a35655493d3aa9, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:12.834431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:12.923334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 993/1943] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:12 2022] PUT /identity/v3/projects/2eb0d30313164a74ae7e3e4c8970e7ba/users/4cd89e58b97f4eb6a7a35655493d3aa9/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:12.925912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:12.927005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:12.927591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:12.939019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:13.014317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] MFA Rules not processed for user `4cd89e58b97f4eb6a7a35655493d3aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:13.020710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:13.220697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 951/1944] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:13.225123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:13.420042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3086d7-3ebd-44ac-b085-86aa4152a38d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:13.440287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:13.445485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:13.445884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:13.447000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:13.449958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:13.467145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:13.586052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 994/1945] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:13 2022] POST /identity/v3/projects => generated 385 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:13.587604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:13.619715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8da3d7-f243-4e49-8329-67aa1c3ff06e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:13.790631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:13.791348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:13.791689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:13.792013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:13.792698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:13.794854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:13.818843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 952/1946] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:13 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:13.822792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:13.837403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f055c7-9520-422f-a28d-db497edae32b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:13.844077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:13.845153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:13.845652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:13.846221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:13.847081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:13.851059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:13.869230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 995/1947] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:13.874004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:13.892073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bc9c-44e8-4d48-96d5-eec9e82d8589 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:13.909172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:13.909894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:13.910180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:13.910622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:13.911302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:13.917014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db759-93a1-4223-bceb-0abe5ce7c60e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:13.930576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 953/1948] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:13.934702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:13.946819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bcbc-3e18-46ea-a029-06b694699123 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:13.952747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:13.954095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:13.954615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:13.955113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] PATH_INFO: `/v3/projects/7bbc820565f34a94b73cb2d8a66765fe/users/041829adeaf846499a3f73b3778937f4/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:13.998265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbc820565f34a94b73cb2d8a66765fe, user_id=041829adeaf846499a3f73b3778937f4, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.000976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.015816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 996/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:13 2022] PUT /identity/v3/projects/7bbc820565f34a94b73cb2d8a66765fe/users/041829adeaf846499a3f73b3778937f4/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:14.030319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.030769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.031181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.075052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] MFA Rules not processed for user `041829adeaf846499a3f73b3778937f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:14.076665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:14.210989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 954/1950] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:14.215457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.301420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:14.336255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623940-3c3c-4306-8e3a-9a83a6ed7c84 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.349779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.350684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.351122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.351550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.353031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.355737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.400019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 997/1951] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:14 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:14.401107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.407728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:14.419326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36ad87-541f-4f84-947f-89edce79c809 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.486228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.487113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.487387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.487691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.489023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.491410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.517764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 955/1952] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:14 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:14.521707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.559109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e312d9-0b75-418b-bdf2-9e3bee9fb626 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.578249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.578930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.579178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.579595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.580276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.582100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.593987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 998/1953] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:14.598364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.623427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012dc4d-aee6-4140-abf7-af4eaf47f642 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.631630 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.633146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.633479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.633696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] PATH_INFO: `/v3/projects/f2a9e196bb0a488f9857292c5b4d2556/users/b48d95e0868c47d79267a2164f61b795/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.666643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a9e196bb0a488f9857292c5b4d2556, user_id=b48d95e0868c47d79267a2164f61b795, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.669858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.684811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 956/1954] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:14 2022] PUT /identity/v3/projects/f2a9e196bb0a488f9857292c5b4d2556/users/b48d95e0868c47d79267a2164f61b795/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:14.696505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.724779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40064-ea5c-4f6f-862f-5eebee233728 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.867774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.868513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.869078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.869756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.870036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.871757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6764aff-3d52-4c82-be6b-6185b4f8bb7e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.889990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 999/1955] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:14.894216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:14.910871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f665f-f7ee-4b25-a166-015ef2ef00d8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:14.923556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:14.924430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.924791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.926330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] PATH_INFO: `/v3/projects/f2a9e196bb0a488f9857292c5b4d2556/users/b48d95e0868c47d79267a2164f61b795/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.932085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a9e196bb0a488f9857292c5b4d2556, user_id=b48d95e0868c47d79267a2164f61b795, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:14.935480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:14.949915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 957/1956] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:14 2022] PUT /identity/v3/projects/f2a9e196bb0a488f9857292c5b4d2556/users/b48d95e0868c47d79267a2164f61b795/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:14.961059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:14.961351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:14.961629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:14.998016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] MFA Rules not processed for user `b48d95e0868c47d79267a2164f61b795`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:14.999515 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.093529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1000/1957] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:15.105790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:15.108955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.210276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33e1ff-32b6-43b3-889d-202a6169aab9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:15.218056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:15.220462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:15.224953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:15.225243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:15.244942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:15.246878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.314407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:15.314407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b0e3-27f3-47e1-8152-2c2a2bbf93a4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:15.317039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:15.331284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 958/1958] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:15.349489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e692-275f-4729-9ea8-53e54f39dbe9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:15.363283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:15.364832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:15.365325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:15.365775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] PATH_INFO: `/v3/users/1f5b0a4a7c5c45eca70cd6f9b721d15c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:15.367214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5b0a4a7c5c45eca70cd6f9b721d15c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:15.369816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:15.471328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5b0a4a7c5c45eca70cd6f9b721d15c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:15.496087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5b0a4a7c5c45eca70cd6f9b721d15c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:15.498982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5b0a4a7c5c45eca70cd6f9b721d15c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:15.512871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5b0a4a7c5c45eca70cd6f9b721d15c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:15.514079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5b0a4a7c5c45eca70cd6f9b721d15c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:15.534967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1001/1959] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:15 2022] DELETE /identity/v3/users/1f5b0a4a7c5c45eca70cd6f9b721d15c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:15.540206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:15.541253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:15.541748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:15.578931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:15.580671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.592291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:15.644300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:15.646074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.693203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 959/1960] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:15.727231 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:15.731149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:15.821288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca103-fabc-4633-ab8f-60204451da03 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:15.831932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558305ff-1035-4050-ba6e-8896089318f1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:15.836697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:15.837572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:15.838044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:15.838445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:15.847010 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:15.847765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:15.848101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:15.848675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] PATH_INFO: `/v3/users/1ab49e4cd4a64ab7b1402b86242d1ce1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:15.850223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab49e4cd4a64ab7b1402b86242d1ce1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:15.852228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:15.853527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:15.855813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935c35c-c3f6-4ac0-bffb-f57009bc2e2c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:15.876463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 960/1961] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:15.990991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab49e4cd4a64ab7b1402b86242d1ce1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.011520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:16.026104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab49e4cd4a64ab7b1402b86242d1ce1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.027014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab49e4cd4a64ab7b1402b86242d1ce1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.038450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab49e4cd4a64ab7b1402b86242d1ce1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.039331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab49e4cd4a64ab7b1402b86242d1ce1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.060736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1002/1962] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:15 2022] DELETE /identity/v3/users/1ab49e4cd4a64ab7b1402b86242d1ce1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:16.066448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db79-0977-4331-a483-983983e785ba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:16.066891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db79-0977-4331-a483-983983e785ba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:16.067384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db79-0977-4331-a483-983983e785ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:16.110357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9e98db79-0977-4331-a483-983983e785ba None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:16.122970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e98db79-0977-4331-a483-983983e785ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:16.266754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 961/1963] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:16.273270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:16.275448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:16.404716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb962c-12ce-4bf9-a00a-ea4ee708c802 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:16.415850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:16.418168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:16.418792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:16.419330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:16.440118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:16.443648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:16.462988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1003/1964] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:16.468637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98db79-0977-4331-a483-983983e785ba None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:16.470116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e98db79-0977-4331-a483-983983e785ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:16.485423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98db79-0977-4331-a483-983983e785ba None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:16.525790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:16.530085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:16.531414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:16.531957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] PATH_INFO: `/v3/projects/598e9fe4dde543deb243732d3279c92c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:16.533872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598e9fe4dde543deb243732d3279c92c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:16.536737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:16.639752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:16.643003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598e9fe4dde543deb243732d3279c92c', 'request_id': 'req-24b59877-46d7-4e6c-af19-6c53fa8116b5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.654426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598e9fe4dde543deb243732d3279c92c', 'request_id': 'req-24b59877-46d7-4e6c-af19-6c53fa8116b5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.667107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598e9fe4dde543deb243732d3279c92c', 'request_id': 'req-24b59877-46d7-4e6c-af19-6c53fa8116b5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.682764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] The token cache is being invalidate because project 598e9fe4dde543deb243732d3279c92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:16.683184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.683981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.685990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 962/1965] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:16 2022] DELETE /identity/v3/projects/598e9fe4dde543deb243732d3279c92c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:16.689843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:16.705898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940c15-9109-4f26-b784-61ea223f37cd service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:16.827394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:16.828131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:16.828557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:16.828941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] PATH_INFO: `/v3/users/80c128681e02441ebb21e61448e53c55` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:16.830713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c128681e02441ebb21e61448e53c55)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:16.834509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:16.862963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:16.865011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:16.887942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b59877-46d7-4e6c-af19-6c53fa8116b5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:16.892086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c128681e02441ebb21e61448e53c55'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.894572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:16.895759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:16.896041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:16.896315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] PATH_INFO: `/v3/projects/678e0081c7914773ac51742ab1dae1c9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:16.897492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678e0081c7914773ac51742ab1dae1c9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:16.899563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:16.906738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c128681e02441ebb21e61448e53c55'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.907446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c128681e02441ebb21e61448e53c55'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.914841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c128681e02441ebb21e61448e53c55'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.915482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c128681e02441ebb21e61448e53c55'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.925046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:16.935420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1004/1966] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:16 2022] DELETE /identity/v3/users/80c128681e02441ebb21e61448e53c55 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:16.956612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678e0081c7914773ac51742ab1dae1c9', 'request_id': 'req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.964022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678e0081c7914773ac51742ab1dae1c9', 'request_id': 'req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.974760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678e0081c7914773ac51742ab1dae1c9', 'request_id': 'req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.998758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] The token cache is being invalidate because project 678e0081c7914773ac51742ab1dae1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:16.999222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:16.999909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.001899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 963/1967] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:16 2022] DELETE /identity/v3/projects/678e0081c7914773ac51742ab1dae1c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:17.006712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.008400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.096617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7934a3-267a-44e7-b977-58ff6ee84ae3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.217912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.219447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.235273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.236377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.237030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.237502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] PATH_INFO: `/v3/users/afb2a05942284a709d0f5830526deb84` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.239143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb2a05942284a709d0f5830526deb84)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.241554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.324460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb2a05942284a709d0f5830526deb84'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.326314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c64ff-a125-477b-ba30-daeff7cbfdf4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.330080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.330706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.331199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.331486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.333389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.341243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb2a05942284a709d0f5830526deb84'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.341896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb2a05942284a709d0f5830526deb84'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.350123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb2a05942284a709d0f5830526deb84'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.350880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb2a05942284a709d0f5830526deb84'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.365492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1005/1968] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:17 2022] DELETE /identity/v3/users/afb2a05942284a709d0f5830526deb84 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:17.366432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.367774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.404629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:17.408094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.411671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a49da-7a7a-4d69-9f12-bd8b73e06f8d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.421392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 964/1969] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:17.453664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631548e-2fad-48a5-b410-082161ac7678 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.459449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.460338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.460717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.461085 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] PATH_INFO: `/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.462418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4350a3c11a43eda9dd89aa599dcb90)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.464453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.525089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4350a3c11a43eda9dd89aa599dcb90', 'request_id': 'req-d50b9ece-4c36-4adc-b539-19eb43768ff0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.538515 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4350a3c11a43eda9dd89aa599dcb90', 'request_id': 'req-d50b9ece-4c36-4adc-b539-19eb43768ff0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.551229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4350a3c11a43eda9dd89aa599dcb90', 'request_id': 'req-d50b9ece-4c36-4adc-b539-19eb43768ff0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.570238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] The token cache is being invalidate because project aa4350a3c11a43eda9dd89aa599dcb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:17.571023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.572687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d50b9ece-4c36-4adc-b539-19eb43768ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.575094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1006/1970] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:17 2022] DELETE /identity/v3/projects/aa4350a3c11a43eda9dd89aa599dcb90 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:17.580597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.581497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.581858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.625600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:17.630232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.644197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:17.733851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 965/1971] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:17.742333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.742749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.743139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.773146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:17.774865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.788727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1007/1972] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:17.793411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.795666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.808755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.811293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a902-cd1c-4e6b-9164-798685ceb13a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.816262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.817322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.817603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.818119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] PATH_INFO: `/v3/projects/c43d8c3820f448239c2175ceaf8f103a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.819973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43d8c3820f448239c2175ceaf8f103a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.822310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.830349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8e707-91a0-4cd4-a859-a0e60fad539e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.837582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.838474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.838681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.838949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.840018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:17.840353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.843369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.869927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1008/1973] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:17.874570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:17.885753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea632093-e982-4ad7-a9b0-e13000745008 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:17.888180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43d8c3820f448239c2175ceaf8f103a', 'request_id': 'req-0473cdce-b25f-4417-8962-5b6bb2c94f3f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.897498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43d8c3820f448239c2175ceaf8f103a', 'request_id': 'req-0473cdce-b25f-4417-8962-5b6bb2c94f3f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.906585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43d8c3820f448239c2175ceaf8f103a', 'request_id': 'req-0473cdce-b25f-4417-8962-5b6bb2c94f3f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.941350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] The token cache is being invalidate because project c43d8c3820f448239c2175ceaf8f103a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:17.941350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.941350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0473cdce-b25f-4417-8962-5b6bb2c94f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:17.941350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 966/1974] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:17 2022] DELETE /identity/v3/projects/c43d8c3820f448239c2175ceaf8f103a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:17.941350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bd5a-9250-4a29-99a8-ecb7615c274d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.942512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bd5a-9250-4a29-99a8-ecb7615c274d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.942512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006bd5a-9250-4a29-99a8-ecb7615c274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.972729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:17.973891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:17.974167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c006bd5a-9250-4a29-99a8-ecb7615c274d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:17.974309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:17.974419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:17.975153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:17.975936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c006bd5a-9250-4a29-99a8-ecb7615c274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:17.977902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:17.998142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 967/1975] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:18.009631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.010852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.011140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.041072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1009/1976] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:17 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:18.047001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.052358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:18.052743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.054664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.095053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:18.137295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 968/1977] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:18.141973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.153613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707421-bb8e-4950-a1ac-cb6fe43d3cc1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.158693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.159143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.159422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.159796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.160951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:18.161257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.162905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.179855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb24e4-64e4-4398-b87d-0c0ade0404ff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.184906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 969/1978] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:18.186042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.190108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.190739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.191045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.191285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.192034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.194369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.198205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f984673-89f8-4a66-a20a-958de827e7d1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.203202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.204257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.204947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.205245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.205889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.208346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.226207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1010/1979] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:18.226706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:18.231356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.244495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b27-a802-43f6-beb3-6a4df2c6b2e0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.254659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.255428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.255777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.256156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.256952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.259510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.268628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 970/1980] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:18.272187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1011/1981] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:18.273824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.279167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.289758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6677-2ec1-4cb1-a9b5-239d271e6269 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.358332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68814-b663-4d1a-9e3e-82827f37d24a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.370000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.370774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.371463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.371741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.372016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.372708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.372974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.373269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.373553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.374240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.374823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.375862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.391467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1012/1982] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:18.391467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.398283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.410852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 971/1983] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:18.412451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.427821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e6a53-e2a4-4100-a127-237aa9c78c26 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.434161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.434848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.435089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.435362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] PATH_INFO: `/v3/projects/9a43372429364bbb98d6e71fe4d12751/users/42a45f52c6e9452a81b52c80aee98ccb/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.454861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a43372429364bbb98d6e71fe4d12751, user_id=42a45f52c6e9452a81b52c80aee98ccb, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.458234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.464273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2d62-679c-4807-80f0-527f84f0a093 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.469131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.469849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.470128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.470392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.472339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.477061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 972/1984] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:18 2022] PUT /identity/v3/projects/9a43372429364bbb98d6e71fe4d12751/users/42a45f52c6e9452a81b52c80aee98ccb/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:18.486058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.545121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:18.560414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f685-3052-4e24-8b56-5b4cbea521b0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.564738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.566207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68944-8de2-4664-8790-47ebc3f48c5f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.567379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.568279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.568749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.569261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.570056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.571795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.578582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1013/1985] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:18.580205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9592-cbff-4f46-a5b5-43c2d0920055 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.580495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9592-cbff-4f46-a5b5-43c2d0920055 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.580826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9592-cbff-4f46-a5b5-43c2d0920055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.583531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 973/1986] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:18.587506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.604446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d77e8-c066-4408-9db9-782fed81d811 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.617616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.618244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.618605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.618798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.619453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.622312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.631274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d72b9592-cbff-4f46-a5b5-43c2d0920055 None None] MFA Rules not processed for user `42a45f52c6e9452a81b52c80aee98ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:18.632704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d72b9592-cbff-4f46-a5b5-43c2d0920055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.642837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 974/1987] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:18.646898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.664823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba7977-a626-4df8-bc7e-994b7e737229 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.674393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.676275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.676676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.681935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] PATH_INFO: `/v3/projects/7d1e4addf55a497799b7da67838b8420/users/fd2a30a047694eadb80bd81181caf074/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.702232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1e4addf55a497799b7da67838b8420, user_id=fd2a30a047694eadb80bd81181caf074, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.706012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.742774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 975/1988] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:18 2022] PUT /identity/v3/projects/7d1e4addf55a497799b7da67838b8420/users/fd2a30a047694eadb80bd81181caf074/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:18.753490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1014/1989] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:18.759362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.763971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.764268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.764555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.787879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:18.793336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] MFA Rules not processed for user `fd2a30a047694eadb80bd81181caf074`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:18.794547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:18.832106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dc98-df3d-48d9-a7a1-924749e4dc43 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.837032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.837672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.837951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.838224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.838857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.840789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.864504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1015/1990] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:18.869141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.869324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 976/1991] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:18.873672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.883754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc5a78-72f0-4f7f-b159-7be97711ec51 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.938948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afcc0-db6d-4ce8-ab98-721c849bef0d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.944453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.945122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.945411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.945790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.946436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.949193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.950643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:18.951318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:18.951890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:18.952175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:18.953304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:18.955310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:18.967980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:18.974998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 977/1992] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:18.979582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:18.992294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e593-f911-44af-b122-0bfde9060009 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:18.996082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1016/1993] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:19.000355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.066218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.067015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.067360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.067701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.068414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.070122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.078841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b421a-a163-4937-8292-d3ff8166bab3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.079902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 978/1994] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:19.084184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.084717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.084823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.085122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.085363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.085993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.087905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.094305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4553d19-3a47-4a0e-9da5-6e4209a944ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.099567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.100223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.100508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.100909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] PATH_INFO: `/v3/projects/e4477b9011264bb5985add5e410f44f6/users/630eeefc3c844387ab59c993e5bc5234/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.112603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1017/1995] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:18 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:19.115357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.116810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4477b9011264bb5985add5e410f44f6, user_id=630eeefc3c844387ab59c993e5bc5234, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.119619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.125293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134034f3-af72-43bc-a066-1d753a3f9a32 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.130158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.130790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.131107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.132551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.132551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.133907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.134906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 979/1996] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:19 2022] PUT /identity/v3/projects/e4477b9011264bb5985add5e410f44f6/users/630eeefc3c844387ab59c993e5bc5234/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:19.139372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.147918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1018/1997] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:19.151784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:19.152256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.163446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3df6a4-967a-4e76-b72a-aaa6d7930cbb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.212225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08640cf-8df9-43da-9659-2588b5e8c296 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.216889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.217531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.217815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.218093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.218738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.220318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.240763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 980/1998] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:19.241103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.242029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.242141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.242620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.242903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] PATH_INFO: `/v3/projects/f5385c929ece49b9b4c544f6731873a8/users/ac274fa856f048d0b62560fc46051293/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.255047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bdd65-1007-480a-beca-e9cff45cfd61 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.261189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5385c929ece49b9b4c544f6731873a8, user_id=ac274fa856f048d0b62560fc46051293, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.262870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.263689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.264050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.264402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] PATH_INFO: `/v3/projects/e4477b9011264bb5985add5e410f44f6/users/630eeefc3c844387ab59c993e5bc5234/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.264518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.266794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4477b9011264bb5985add5e410f44f6, user_id=630eeefc3c844387ab59c993e5bc5234, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.270404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60948198-5754-42c5-a622-d14d50293973 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.282134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1019/1999] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:19 2022] PUT /identity/v3/projects/f5385c929ece49b9b4c544f6731873a8/users/ac274fa856f048d0b62560fc46051293/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:19.282592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 981/2000] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:19 2022] PUT /identity/v3/projects/e4477b9011264bb5985add5e410f44f6/users/630eeefc3c844387ab59c993e5bc5234/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:19.286111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.293864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.294156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.294429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.330680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] MFA Rules not processed for user `630eeefc3c844387ab59c993e5bc5234`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:19.332125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:19.357525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:19.370185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388da8e-60fa-416a-9693-51ca0fe7756d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.410223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 982/2001] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:19.422077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.423612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:19.431508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.432126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.432439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.432752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.433407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.434991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.451006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1020/2002] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:19.452421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.463840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1e90-3bb7-4f71-9135-0cc32d7a73fa admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.468922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.469612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.469897 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.470171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] PATH_INFO: `/v3/projects/f5385c929ece49b9b4c544f6731873a8/users/ac274fa856f048d0b62560fc46051293/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.472393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5385c929ece49b9b4c544f6731873a8, user_id=ac274fa856f048d0b62560fc46051293, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.475732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aab4b-fb90-4972-b5a6-4d1e8ed02028 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.485379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf000f-122c-4d0f-9a40-e6026d9ec9ee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.486673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1021/2003] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:19 2022] PUT /identity/v3/projects/f5385c929ece49b9b4c544f6731873a8/users/ac274fa856f048d0b62560fc46051293/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:19.497979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.498386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.498739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.515663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:19.528763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] MFA Rules not processed for user `ac274fa856f048d0b62560fc46051293`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:19.529993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:19.545266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.545908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.546195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.546474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.604876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1022/2004] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:19.608738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.610345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.615891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:19.620517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 983/2005] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:19.625125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b043578-46e6-436a-bf63-6e79a73f632e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:19.628835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:19.630008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:19.630291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:19.630567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:19.691923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:19.693051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2abf8-e148-46e4-bb8c-f9066f88da8f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:19.702122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1023/2006] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:20.431325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:20.499371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f150a-9b84-4a95-8b70-8db577619830 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:20.504603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:20.505283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:20.505586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:20.505914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] PATH_INFO: `/v3/users/42a45f52c6e9452a81b52c80aee98ccb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:20.507344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a45f52c6e9452a81b52c80aee98ccb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:20.510073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:20.561315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a45f52c6e9452a81b52c80aee98ccb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:20.562127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a45f52c6e9452a81b52c80aee98ccb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:20.562732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a45f52c6e9452a81b52c80aee98ccb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:20.570804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a45f52c6e9452a81b52c80aee98ccb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:20.583398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a45f52c6e9452a81b52c80aee98ccb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:20.597182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 984/2007] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:20 2022] DELETE /identity/v3/users/42a45f52c6e9452a81b52c80aee98ccb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:20.601755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:20.602246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:20.602361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:20.610544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:20.622987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:20.624261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:20.692890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1024/2008] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:20.704097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:20.705611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:20.712603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:20.775845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43e3a0-b8e3-4709-9f97-9a7b1ee856e0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:20.779587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:20.780271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:20.780652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:20.781026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:20.790205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:20.791633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:20.801750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 985/2009] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:21.086628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:21.088214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:21.101705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717da871-b368-47d4-8f74-cfd023154e23 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:21.107100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:21.107534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:21.107818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:21.108099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] PATH_INFO: `/v3/projects/9a43372429364bbb98d6e71fe4d12751` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:21.109266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a43372429364bbb98d6e71fe4d12751)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:21.111219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:21.201436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a43372429364bbb98d6e71fe4d12751', 'request_id': 'req-d78c12ea-33cc-435f-9cd9-2159f63017c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.208048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a43372429364bbb98d6e71fe4d12751', 'request_id': 'req-d78c12ea-33cc-435f-9cd9-2159f63017c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.220243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a43372429364bbb98d6e71fe4d12751', 'request_id': 'req-d78c12ea-33cc-435f-9cd9-2159f63017c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.253772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] The token cache is being invalidate because project 9a43372429364bbb98d6e71fe4d12751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:21.254233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.257628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.262035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1025/2010] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:21 2022] DELETE /identity/v3/projects/9a43372429364bbb98d6e71fe4d12751 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:21.263489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:21.283036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c38c2-f1bf-44f5-bf91-6cb3616f7763 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:21.399091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:21.399912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:21.400197 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:21.400473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] PATH_INFO: `/v3/users/630eeefc3c844387ab59c993e5bc5234` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:21.401660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630eeefc3c844387ab59c993e5bc5234)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:21.403983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:21.482453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630eeefc3c844387ab59c993e5bc5234'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.483443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630eeefc3c844387ab59c993e5bc5234'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.484282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630eeefc3c844387ab59c993e5bc5234'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.497513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630eeefc3c844387ab59c993e5bc5234'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.514931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2b4e06f9-aa70-479d-ae31-ab5253a31da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630eeefc3c844387ab59c993e5bc5234'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:21.535887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 986/2011] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:21 2022] DELETE /identity/v3/users/630eeefc3c844387ab59c993e5bc5234 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:22.103260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.105165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:22.127639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c12ea-33cc-435f-9cd9-2159f63017c2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.218404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.219132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.219477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.219821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] PATH_INFO: `/v3/projects/e4477b9011264bb5985add5e410f44f6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.221098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4477b9011264bb5985add5e410f44f6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.223823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.312439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:22.333649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4477b9011264bb5985add5e410f44f6', 'request_id': 'req-74136dec-c724-4614-a3ad-3bbb9886299e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:22.341005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4477b9011264bb5985add5e410f44f6', 'request_id': 'req-74136dec-c724-4614-a3ad-3bbb9886299e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:22.356149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4477b9011264bb5985add5e410f44f6', 'request_id': 'req-74136dec-c724-4614-a3ad-3bbb9886299e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:22.392550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] The token cache is being invalidate because project e4477b9011264bb5985add5e410f44f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:22.393143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:22.394182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74136dec-c724-4614-a3ad-3bbb9886299e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:22.396057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1026/2012] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:22 2022] DELETE /identity/v3/projects/e4477b9011264bb5985add5e410f44f6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:22.401005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.401375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.401560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.444388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:22.445646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:22.486884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:22.537116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 987/2013] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:22.545696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.546808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.547148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.576728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:22.578081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:22.593261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1027/2014] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:22.597444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.609691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d2ce-e8f5-4c0f-b364-dd1de24338bc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.615560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.616510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.617055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.617422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.618195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:22.618625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.620408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.635964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 988/2015] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:22.640721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.654580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee2a3-3e1e-4de5-920f-85e6074f9c4c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.661637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.662559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.662850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.663134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.663785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.665812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.717702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.717866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1028/2016] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:22 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:22.737715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6461e-85f1-4bdb-9d35-d931a3d71bb3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.826636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.827287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.827813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.828090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.828932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.832289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.879811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 989/2017] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:22 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:22.890458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.906303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea9d6-1b1e-4d3e-b9fc-50400df03b01 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.915557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.916210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.916493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.916803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.917504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.921482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.946091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1029/2018] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:22.946947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.957096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:22.961472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:22.961984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166eb34-bdd5-4738-a317-77aefe5fb4f2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:22.968059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:22.968717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:22.969000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:22.969969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:22.971043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:22.972931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:22.984436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918c31-afc6-4922-9da3-df499a4495a0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.005328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 990/2019] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:23.007023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.008227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.009604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.009876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.010150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] PATH_INFO: `/v3/users/4cd89e58b97f4eb6a7a35655493d3aa9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.012194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd89e58b97f4eb6a7a35655493d3aa9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.014882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.023201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f7446-2037-49a3-ad47-b4a69006e15e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.030471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.031155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.031447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.031734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] PATH_INFO: `/v3/projects/f20c604736e14eb8990efe55e31100fc/users/972c2b3aa1e449ad95e37cf0fa3e1710/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.048471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20c604736e14eb8990efe55e31100fc, user_id=972c2b3aa1e449ad95e37cf0fa3e1710, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.052047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e3cb-f44e-4cad-a925-9c2b31039321 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.072057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 991/2020] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:23 2022] PUT /identity/v3/projects/f20c604736e14eb8990efe55e31100fc/users/972c2b3aa1e449ad95e37cf0fa3e1710/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:23.082130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.082348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.082629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.088646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd89e58b97f4eb6a7a35655493d3aa9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:23.106217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd89e58b97f4eb6a7a35655493d3aa9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:23.107222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd89e58b97f4eb6a7a35655493d3aa9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:23.115458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd89e58b97f4eb6a7a35655493d3aa9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:23.116762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-29257d71-2ebe-43f5-88c1-a75739b20629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd89e58b97f4eb6a7a35655493d3aa9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:23.140851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1030/2021] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:22 2022] DELETE /identity/v3/users/4cd89e58b97f4eb6a7a35655493d3aa9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:23.146211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.146740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.147287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.165611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] MFA Rules not processed for user `972c2b3aa1e449ad95e37cf0fa3e1710`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:23.167298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:23.176941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:23.178400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:23.256471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:23.262533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:23.287861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1031/2022] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:23.296410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 992/2023] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:23.301045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.304160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.309990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:23.310126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:23.369497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf2251-590b-4309-9ad1-3f12e103a575 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.387640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.388435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.389386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.390119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.391497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.396809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.397094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f34f26-4f9f-4526-8133-e01bde40efc9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.401828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.402658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.407708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.408046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.424288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.426005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.452643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1032/2025] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:23 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:23.452799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 993/2025] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:23.454452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.535040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609a97-61c7-438b-8e0d-4067187159bd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.539948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.540585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.540883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.541159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.541797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.543717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.568226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1033/2026] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:23 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:23.572389 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.583090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0f87-6c00-43f0-bf56-60b2bcdc5271 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.588335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.589162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.589526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.589860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.591178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.592639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.609590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 994/2027] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:23.613126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.626150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0feeb-bf54-49b1-b789-347eb2246d3d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.632992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.633685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.633967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.634243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] PATH_INFO: `/v3/projects/3a0b486633034b7db83a5a2e0534ac05/users/b9a718b3900948b99b7cdc5e5adae1fa/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.652979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b486633034b7db83a5a2e0534ac05, user_id=b9a718b3900948b99b7cdc5e5adae1fa, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.657433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.673515 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1034/2028] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:23 2022] PUT /identity/v3/projects/3a0b486633034b7db83a5a2e0534ac05/users/b9a718b3900948b99b7cdc5e5adae1fa/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:23.679078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.696087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f31f84-c196-4988-9869-9b3d6b9315f6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.873411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.874397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.875660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.876015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.879701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.881595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39ac13-4f03-4e50-a129-a02938bead91 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.896232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 995/2029] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:23.905811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:23.925257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8624f-0fed-47b5-a4e3-42ce059db48f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:23.934792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:23.935726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.936013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.937537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] PATH_INFO: `/v3/projects/3a0b486633034b7db83a5a2e0534ac05/users/b9a718b3900948b99b7cdc5e5adae1fa/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:23.941015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b486633034b7db83a5a2e0534ac05, user_id=b9a718b3900948b99b7cdc5e5adae1fa, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:23.945233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:23.962904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1035/2030] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:23 2022] PUT /identity/v3/projects/3a0b486633034b7db83a5a2e0534ac05/users/b9a718b3900948b99b7cdc5e5adae1fa/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:23.974988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:23.975279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:23.975567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.015115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] MFA Rules not processed for user `b9a718b3900948b99b7cdc5e5adae1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:24.016357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.020057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.021795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.121516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c6ea-8c7f-4813-a261-22abd864ed6e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.128011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.128767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.129165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.129504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] PATH_INFO: `/v3/projects/2eb0d30313164a74ae7e3e4c8970e7ba` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.131026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb0d30313164a74ae7e3e4c8970e7ba)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.133300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.147421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 996/2031] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:24.159804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.162551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.167991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:24.175522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:24.211196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb0d30313164a74ae7e3e4c8970e7ba', 'request_id': 'req-0f56925b-0d25-428b-9ac2-215fc742f601'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.219815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb0d30313164a74ae7e3e4c8970e7ba', 'request_id': 'req-0f56925b-0d25-428b-9ac2-215fc742f601'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.231967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb0d30313164a74ae7e3e4c8970e7ba', 'request_id': 'req-0f56925b-0d25-428b-9ac2-215fc742f601'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.250081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efbd55-e875-46fc-b354-d0e00a5fd560 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.252013 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] The token cache is being invalidate because project 2eb0d30313164a74ae7e3e4c8970e7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:24.252307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.253014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.256604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1036/2032] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:24 2022] DELETE /identity/v3/projects/2eb0d30313164a74ae7e3e4c8970e7ba => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:24.259329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.261538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.334614 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.335469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.335939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.336402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.338436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.369221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56925b-0d25-428b-9ac2-215fc742f601 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.375432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.376158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.376507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.376941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] PATH_INFO: `/v3/users/041829adeaf846499a3f73b3778937f4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.378590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041829adeaf846499a3f73b3778937f4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.382427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.440990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.442587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.459723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041829adeaf846499a3f73b3778937f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.460797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 997/2033] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:24.476344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041829adeaf846499a3f73b3778937f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.477240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041829adeaf846499a3f73b3778937f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.490392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041829adeaf846499a3f73b3778937f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.491400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041829adeaf846499a3f73b3778937f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.517779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1037/2034] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:24 2022] DELETE /identity/v3/users/041829adeaf846499a3f73b3778937f4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:24.618055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.619720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.620154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.622392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.634241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32c36-4f8e-4605-a909-e6f98b4ff09a service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.684987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:24.706161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.706908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.707317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.707660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.710126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.715996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36dba8-832f-4935-8f0e-216980bc36d6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.720074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.720848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.721202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.721681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.724321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.754767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:24.794896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.800958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.801830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.803480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.813018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 998/2035] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:24.813946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.815347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.815856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1038/2036] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:24.892892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a09b2-1bd3-440f-b066-ad54008ae774 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:24.898963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:24.899700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:24.900046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:24.900422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] PATH_INFO: `/v3/users/3736d59b92ef4feb910f6d39d7ac804c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:24.901895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3736d59b92ef4feb910f6d39d7ac804c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:24.905122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:24.954093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:24.955517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:24.975374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3736d59b92ef4feb910f6d39d7ac804c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.978211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3736d59b92ef4feb910f6d39d7ac804c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.979036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3736d59b92ef4feb910f6d39d7ac804c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:24.995182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3736d59b92ef4feb910f6d39d7ac804c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.003962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bad13-983f-4739-98de-dc8f85984b81 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.016693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.017350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.017657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.018075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] PATH_INFO: `/v3/projects/7bbc820565f34a94b73cb2d8a66765fe` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.020499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbc820565f34a94b73cb2d8a66765fe)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.023097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.024811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3736d59b92ef4feb910f6d39d7ac804c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.048085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 999/2037] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:24 2022] DELETE /identity/v3/users/3736d59b92ef4feb910f6d39d7ac804c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:25.131493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbc820565f34a94b73cb2d8a66765fe', 'request_id': 'req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.141649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbc820565f34a94b73cb2d8a66765fe', 'request_id': 'req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.152330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbc820565f34a94b73cb2d8a66765fe', 'request_id': 'req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.170561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] The token cache is being invalidate because project 7bbc820565f34a94b73cb2d8a66765fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:25.171154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.172145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.174382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1039/2038] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:24 2022] DELETE /identity/v3/projects/7bbc820565f34a94b73cb2d8a66765fe => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:25.179335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.181401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:25.266501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:25.295413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9148a-f0df-4b7f-84c5-3437ec4fb5e5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.346505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.348816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:25.386750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.387393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.387675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.387955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] PATH_INFO: `/v3/users/b48d95e0868c47d79267a2164f61b795` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.389326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48d95e0868c47d79267a2164f61b795)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.391486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.449820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e230-0740-4c81-a5f3-9d8ec17d1157 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.453175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48d95e0868c47d79267a2164f61b795'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.453929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48d95e0868c47d79267a2164f61b795'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.454928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48d95e0868c47d79267a2164f61b795'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.456474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.457511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.457785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.458095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] PATH_INFO: `/v3/projects/3f834bc2033f4d89a9a54c7954096357` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.459912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f834bc2033f4d89a9a54c7954096357)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.463078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.463218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48d95e0868c47d79267a2164f61b795'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.476204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:25.479814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-730e73c9-0a9a-4616-aa6c-19d304aaa35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48d95e0868c47d79267a2164f61b795'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.505087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1000/2039] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:25 2022] DELETE /identity/v3/users/b48d95e0868c47d79267a2164f61b795 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:25.535721 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f834bc2033f4d89a9a54c7954096357', 'request_id': 'req-644129c8-9a23-4b04-aa95-7a22b5910cf5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.543035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f834bc2033f4d89a9a54c7954096357', 'request_id': 'req-644129c8-9a23-4b04-aa95-7a22b5910cf5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.554653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f834bc2033f4d89a9a54c7954096357', 'request_id': 'req-644129c8-9a23-4b04-aa95-7a22b5910cf5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.577136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] The token cache is being invalidate because project 3f834bc2033f4d89a9a54c7954096357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:25.577510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.578287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-644129c8-9a23-4b04-aa95-7a22b5910cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:25.581524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1040/2040] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:25 2022] DELETE /identity/v3/projects/3f834bc2033f4d89a9a54c7954096357 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:25.586977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.587544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.587915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.613828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:25.615301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:25.684704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1001/2041] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:25.692778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.694009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.694712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.717629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:25.718979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:25.733819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1041/2042] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:25.738833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.748886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41ff8-854e-4f53-b04e-67a01f0f460d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.754385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.754999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.755354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.755543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.756190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:25.756491 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.758318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.766500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:25.775988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1002/2043] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:25.778905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.791574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b074-9119-44a0-8255-6b68e3e811ae None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.797042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.797680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.797934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.798205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.798870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.800849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.838820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1042/2044] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:25 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:25.842787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.855966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.874391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e63a4-ac04-4a8b-8249-f8c5869a907f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.874622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:25.937736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.938472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.938854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.939242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.940121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.942327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.942820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a76af-45f6-4dca-b04f-5f51a63f1ece admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.947471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.948102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.948392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.948694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] PATH_INFO: `/v3/projects/f2a9e196bb0a488f9857292c5b4d2556` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.949805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a9e196bb0a488f9857292c5b4d2556)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.951700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:25.965085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1003/2045] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:25 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:25.969097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:25.980290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face21c4-24ce-476c-8db0-86475704231d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:25.986410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:25.986852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:25.987141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:25.987412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:25.988081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:25.989729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.000763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1004/2046] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:26.002315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a9e196bb0a488f9857292c5b4d2556', 'request_id': 'req-8112fef7-dfec-4a9f-be8e-233f75750e1d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:26.004870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.007882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a9e196bb0a488f9857292c5b4d2556', 'request_id': 'req-8112fef7-dfec-4a9f-be8e-233f75750e1d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:26.014978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f55-f52b-4506-bd17-fdaee6e6dfd9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.015887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a9e196bb0a488f9857292c5b4d2556', 'request_id': 'req-8112fef7-dfec-4a9f-be8e-233f75750e1d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:26.024643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:26.029646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] The token cache is being invalidate because project f2a9e196bb0a488f9857292c5b4d2556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:26.030098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:26.031133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8112fef7-dfec-4a9f-be8e-233f75750e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:26.033114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1043/2047] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:25 2022] DELETE /identity/v3/projects/f2a9e196bb0a488f9857292c5b4d2556 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:26.038100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740602-2c4f-420e-932b-61142d96b62d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.038385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740602-2c4f-420e-932b-61142d96b62d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.038656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740602-2c4f-420e-932b-61142d96b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.059015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-30740602-2c4f-420e-932b-61142d96b62d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:26.060252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-30740602-2c4f-420e-932b-61142d96b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.077134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.077794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.078072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.078340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.078981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.080542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.090937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1005/2048] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:26.095139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.096817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.111697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07762-510c-4f7a-b1cc-6848fab34cf9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.116724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.117412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.117706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.117971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] PATH_INFO: `/v3/projects/25034d5a23384c50853b065c743fc518/users/8691d33672844a41a97db1587864e31e/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.131174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1044/2049] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:26.139817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.140434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.140434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.142209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25034d5a23384c50853b065c743fc518, user_id=8691d33672844a41a97db1587864e31e, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.146441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0fafd-5219-4b7b-a20e-9baa5867fd0c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.164229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:26.165543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.167762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1006/2050] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:26 2022] PUT /identity/v3/projects/25034d5a23384c50853b065c743fc518/users/8691d33672844a41a97db1587864e31e/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:26.181471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.181471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.181471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.212786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] MFA Rules not processed for user `8691d33672844a41a97db1587864e31e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:26.214112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.257908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1045/2051] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:26.264347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.268709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:26.281904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9273d9-27da-4124-afb3-d3ba989fd033 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.291449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.292185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.292467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.292891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.294141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:26.294737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.296539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.301936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1007/2052] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:26.316809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.319302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dded9d-e936-4dc5-9b98-336187de832a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.324674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1046/2053] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:26.325196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.325347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.326135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.326510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.326881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.327856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.330273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.343133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25751da3-13b5-41f2-9a67-78821f2f3047 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.353585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.354230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.354596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.354878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.355771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.359092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.376221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1008/2054] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:26.380939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.400755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1047/2055] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:26.404870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.460267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a1c-7023-4f65-b792-7aeb1a0e8462 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.499087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2028e-a7d7-464c-9e98-4f64a25d1310 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.505852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.506850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.507399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.507819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.508665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.510844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.524946 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:26.551717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.552361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1048/2056] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:26.553434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.553957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.554543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.555708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.557031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.559740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.590391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8527a-a6c6-4309-9d62-d8fb0c709bb0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.611953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.613372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.613875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.614423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.615411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.615689 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1009/2057] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:26.619811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.620007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.633846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1049/2058] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:26.637626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.639450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32ab5-c9ff-47aa-92de-e52e78433d0b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.649066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.649711 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.650065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.650230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.651046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.653046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.664321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8dde-168b-4bd0-97d7-2ce757ae5066 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.674301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1010/2059] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:26.680657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.681132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.682322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.682947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.683363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.684131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.685924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.693900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5434643-5bcb-4199-8628-87e06e5edea0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.704588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.705413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.705800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.706184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] PATH_INFO: `/v3/projects/06edf789e8cb4ef89a0c40df38105b3e/users/27cf1a24df664e9faba6fef80874012e/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.716817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1050/2060] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:26.721502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.734051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06edf789e8cb4ef89a0c40df38105b3e, user_id=27cf1a24df664e9faba6fef80874012e, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.737382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.741501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e647-dac9-45e1-bdf8-2af68e956f21 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.764357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.765235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.765734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.766226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] PATH_INFO: `/v3/projects/932715d4f93846efbac2f2261686a128/users/96bf5095b2004bccb0005257f1cecebf/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.766980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1011/2061] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:26 2022] PUT /identity/v3/projects/06edf789e8cb4ef89a0c40df38105b3e/users/27cf1a24df664e9faba6fef80874012e/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:26.771451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.785735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932715d4f93846efbac2f2261686a128, user_id=96bf5095b2004bccb0005257f1cecebf, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.788780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f465e1-2578-43d1-8adb-1ed5f72990b4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.794454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:26.806723 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1051/2062] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:26 2022] PUT /identity/v3/projects/932715d4f93846efbac2f2261686a128/users/96bf5095b2004bccb0005257f1cecebf/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:26.818222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.818510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.818788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.848416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] MFA Rules not processed for user `96bf5095b2004bccb0005257f1cecebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:26.849728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.856878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634555-49c9-4087-b8f6-236aea65cb3d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.939758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.941238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.941677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.942068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.942753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:26.944606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1052/2063] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:26.945598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:26.957165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.959120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:26.959638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1012/2064] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:26.963932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:26.978175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c20cf-c468-4773-85a9-add6c0b493a9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:26.990451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:26.991254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:26.991601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:26.992054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] PATH_INFO: `/v3/projects/06edf789e8cb4ef89a0c40df38105b3e/users/27cf1a24df664e9faba6fef80874012e/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:26.997674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06edf789e8cb4ef89a0c40df38105b3e, user_id=27cf1a24df664e9faba6fef80874012e, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:27.002685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707ac8-3849-4668-982e-81587d293211 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:27.019524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1013/2065] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:26 2022] PUT /identity/v3/projects/06edf789e8cb4ef89a0c40df38105b3e/users/27cf1a24df664e9faba6fef80874012e/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:27.031625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:27.032055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:27.032196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:27.048413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157ca4-6d18-4daf-a04d-11b702f90207 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:27.068841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] MFA Rules not processed for user `27cf1a24df664e9faba6fef80874012e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:27.070196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:27.143663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:27.144594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:27.144893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:27.145171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:27.167738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:27.196588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1014/2066] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:27.209550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:27.210951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:27.223697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd1bf1-7eef-4df7-9315-0e826307eff4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:27.227115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:27.228160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:27.228585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:27.228898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:27.240019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:27.241482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:27.242741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:27.244161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:27.251219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1015/2067] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:27.254774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1053/2068] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:27.297061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:27.306430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a46a-813a-4dbd-a0f8-df3e1e7837e4 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:27.311745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:27.312417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:27.312740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:27.313021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:27.330580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:27.375715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:27.377991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8de97-c52a-4022-b0c3-e494ac2ccbea service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:27.387951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1016/2069] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:30.140275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:30.141982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:30.211618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e00fe-10c2-4f9b-a73c-3e444d50ff36 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:30.217208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:30.217845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:30.218125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:30.218400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] PATH_INFO: `/v3/users/fd2a30a047694eadb80bd81181caf074` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:30.219507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2a30a047694eadb80bd81181caf074)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:30.221579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:30.273089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2a30a047694eadb80bd81181caf074'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:30.287180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2a30a047694eadb80bd81181caf074'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:30.288226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2a30a047694eadb80bd81181caf074'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:30.296200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2a30a047694eadb80bd81181caf074'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:30.297014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2a30a047694eadb80bd81181caf074'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:30.311271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1054/2070] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:30 2022] DELETE /identity/v3/users/fd2a30a047694eadb80bd81181caf074 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:30.315946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:30.316536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:30.316536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:30.342221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:30.343476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:30.423576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1017/2071] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:30.430599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:30.432023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:30.476793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:30.514814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f69541-8aef-43c9-93fe-6dd6bb927e77 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:30.522635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:30.523584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:30.523877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:30.524147 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:30.536785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:30.539768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:30.552027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1055/2072] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:30.966702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:30.968975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:30.987254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb7c0-1dd8-40ec-b888-4ecac58c7e93 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:30.992795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:30.993496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:30.993781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:30.994054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] PATH_INFO: `/v3/projects/7d1e4addf55a497799b7da67838b8420` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:30.995191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1e4addf55a497799b7da67838b8420)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:30.997320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:31.065274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1e4addf55a497799b7da67838b8420', 'request_id': 'req-00538f18-cabe-4b97-9633-11711587d053'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.073150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1e4addf55a497799b7da67838b8420', 'request_id': 'req-00538f18-cabe-4b97-9633-11711587d053'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.087094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1e4addf55a497799b7da67838b8420', 'request_id': 'req-00538f18-cabe-4b97-9633-11711587d053'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.101204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] The token cache is being invalidate because project 7d1e4addf55a497799b7da67838b8420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:31.101697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.104433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.104433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1018/2073] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:30 2022] DELETE /identity/v3/projects/7d1e4addf55a497799b7da67838b8420 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:31.108530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:31.121040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ee49-ed65-4842-924f-e1ff942f1689 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:31.221111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:31.221956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.222227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.222422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] PATH_INFO: `/v3/users/ac274fa856f048d0b62560fc46051293` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.224491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac274fa856f048d0b62560fc46051293)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:31.229269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:31.302177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac274fa856f048d0b62560fc46051293'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.322458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac274fa856f048d0b62560fc46051293'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.324263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac274fa856f048d0b62560fc46051293'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.335200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac274fa856f048d0b62560fc46051293'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.335942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac274fa856f048d0b62560fc46051293'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.353732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1056/2074] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:31 2022] DELETE /identity/v3/users/ac274fa856f048d0b62560fc46051293 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:31.381839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:31.383719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.405818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:31.405962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00538f18-cabe-4b97-9633-11711587d053 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:31.407443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.467724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:31.474686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:31.493366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:31.494180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.495861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.495861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] PATH_INFO: `/v3/users/972c2b3aa1e449ad95e37cf0fa3e1710` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.496073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] RBAC: Authorizing `identity:delete_user(user_id=972c2b3aa1e449ad95e37cf0fa3e1710)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:31.498612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:31.508653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf020-79ff-4dbd-bb1f-c83e14bb89ee admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:31.524748 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:31.525358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.525639 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.525918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] PATH_INFO: `/v3/users/8691d33672844a41a97db1587864e31e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.527530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8691d33672844a41a97db1587864e31e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:31.529579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:31.599828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972c2b3aa1e449ad95e37cf0fa3e1710'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.602945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972c2b3aa1e449ad95e37cf0fa3e1710'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.603441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972c2b3aa1e449ad95e37cf0fa3e1710'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.622925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972c2b3aa1e449ad95e37cf0fa3e1710'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.631333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8691d33672844a41a97db1587864e31e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.653826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-798c96c3-5157-4adf-a3af-810301ad065d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972c2b3aa1e449ad95e37cf0fa3e1710'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.657751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8691d33672844a41a97db1587864e31e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.660536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8691d33672844a41a97db1587864e31e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.673771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8691d33672844a41a97db1587864e31e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.675136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4bb2fd21-486d-4677-8fa0-48dc9a78f799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8691d33672844a41a97db1587864e31e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.682245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1019/2075] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:31 2022] DELETE /identity/v3/users/972c2b3aa1e449ad95e37cf0fa3e1710 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:31.687927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.688492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.689608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.706667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1057/2076] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:31 2022] DELETE /identity/v3/users/8691d33672844a41a97db1587864e31e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:31.712284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.712618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.712978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.723927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:31.725268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.745172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:31.747317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.853947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1020/2077] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:31.855871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:31.857628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.864638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1058/2078] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:31.868202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:31.870106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:31.877556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce1f6b-b805-4f71-a940-bbd560ef9182 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:31.885945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:31.886705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:31.886987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:31.887260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] PATH_INFO: `/v3/projects/f5385c929ece49b9b4c544f6731873a8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:31.888507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5385c929ece49b9b4c544f6731873a8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:31.891261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:31.979593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5385c929ece49b9b4c544f6731873a8', 'request_id': 'req-3cea0ab6-a035-4e98-b7ae-9055840c7953'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:31.981369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bed4d9-e636-41fe-9161-ef692348f64d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.000242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5385c929ece49b9b4c544f6731873a8', 'request_id': 'req-3cea0ab6-a035-4e98-b7ae-9055840c7953'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.007293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:32.020350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:32.021420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5385c929ece49b9b4c544f6731873a8', 'request_id': 'req-3cea0ab6-a035-4e98-b7ae-9055840c7953'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.046897 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] The token cache is being invalidate because project f5385c929ece49b9b4c544f6731873a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:32.047280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.049763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.052414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1021/2079] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:31 2022] DELETE /identity/v3/projects/f5385c929ece49b9b4c544f6731873a8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:32.053913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.062781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.076707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.077467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.077961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.078873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.081345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.104083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0ab6-a035-4e98-b7ae-9055840c7953 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.111849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.112474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.112824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.113635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.115954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.185910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.187510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f047-0feb-45db-9e43-245b8d016bba service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.210222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1059/2080] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:32.211654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.212322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.212803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.226675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.228974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c903-a1bc-42d0-9cf8-851a15df5af6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.242034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1022/2081] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:32.251751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:32.252525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.261981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1060/2082] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:32.272324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.272668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.272952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.295502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:32.296856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.306836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1023/2083] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:32.311099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.324827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605d01-732f-43d0-af1d-e4d0497a34d5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.330663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.331311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.331620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.332043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.334068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:32.334068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.334811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.350836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1061/2084] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:32.355396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.371107 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fce23-7f1a-45d2-bfc2-e59191a34b96 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.377338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.378067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.378350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.378646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.379927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.385714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.430322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1024/2085] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:32 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:32.434950 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.450717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39bb7-6eed-460f-9c91-e40facbd6d68 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.544102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.544940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.545444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.545880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.546547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.548774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.582552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1062/2086] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:32 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:32.586604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.612406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4239d-d927-4b18-aff3-1a8cab0434df admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.623477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.624909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.625669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.626176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.627966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.633173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.661785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1025/2087] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:32.665972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.676784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f64968-0ede-4586-a44c-a61f99739b71 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.690478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.691411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.691754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.692095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.692855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.694681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.712738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1063/2088] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:32.718233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.736185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249434de-b34e-463f-b181-6f854d82ea08 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.747659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.749956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.762708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.763650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.764712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.764712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] PATH_INFO: `/v3/projects/4ac642f2046c42c992391ca09663249f/users/fe67952655044f53b42aa6cf13d336d0/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.795707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc1d9-de65-4640-a2f4-3b51b5c24e09 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.809875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:32.813339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.813785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.814060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] PATH_INFO: `/v3/projects/25034d5a23384c50853b065c743fc518` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.818170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25034d5a23384c50853b065c743fc518)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.820098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.820500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac642f2046c42c992391ca09663249f, user_id=fe67952655044f53b42aa6cf13d336d0, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:32.826000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:32.853411 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1026/2089] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:32 2022] PUT /identity/v3/projects/4ac642f2046c42c992391ca09663249f/users/fe67952655044f53b42aa6cf13d336d0/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:32.854404 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:32.857392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:32.882355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:32.906607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25034d5a23384c50853b065c743fc518', 'request_id': 'req-840052d2-ac47-49e2-8897-7d0894521b3b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.915911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25034d5a23384c50853b065c743fc518', 'request_id': 'req-840052d2-ac47-49e2-8897-7d0894521b3b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.928740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25034d5a23384c50853b065c743fc518', 'request_id': 'req-840052d2-ac47-49e2-8897-7d0894521b3b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.949856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a094-7be6-491a-93b2-e7a25632dcee admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:32.952442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] The token cache is being invalidate because project 25034d5a23384c50853b065c743fc518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:32.952926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.954204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-840052d2-ac47-49e2-8897-7d0894521b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:32.957156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1064/2090] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:32 2022] DELETE /identity/v3/projects/25034d5a23384c50853b065c743fc518 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:32.959945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:32.960457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:32.960924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:32.985837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:33.010199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] MFA Rules not processed for user `fe67952655044f53b42aa6cf13d336d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:33.014171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.046622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.047270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.047609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.048064 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] PATH_INFO: `/v3/projects/f20c604736e14eb8990efe55e31100fc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.050695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20c604736e14eb8990efe55e31100fc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.052494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.123260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1065/2091] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:33.123260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.123260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.125580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20c604736e14eb8990efe55e31100fc', 'request_id': 'req-031e3e3f-31b1-44a7-b650-0346864dde69'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.133719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20c604736e14eb8990efe55e31100fc', 'request_id': 'req-031e3e3f-31b1-44a7-b650-0346864dde69'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.139403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa56c-2d4f-4122-9f7c-1783c0fb37f0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.141552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20c604736e14eb8990efe55e31100fc', 'request_id': 'req-031e3e3f-31b1-44a7-b650-0346864dde69'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.167828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] The token cache is being invalidate because project f20c604736e14eb8990efe55e31100fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:33.168134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.169011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.170834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1027/2092] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:32 2022] DELETE /identity/v3/projects/f20c604736e14eb8990efe55e31100fc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:33.173891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.173891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.265802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.266884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.267679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.268031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] PATH_INFO: `/v3/users/27cf1a24df664e9faba6fef80874012e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.269925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cf1a24df664e9faba6fef80874012e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.272426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.304035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e3e3f-31b1-44a7-b650-0346864dde69 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.327294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.328548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.329038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.329821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.330605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.332921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.360610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cf1a24df664e9faba6fef80874012e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.365233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:33.387706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1028/2093] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:33 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:33.388687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.393318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cf1a24df664e9faba6fef80874012e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.394760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.395184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cf1a24df664e9faba6fef80874012e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.405138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cf1a24df664e9faba6fef80874012e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.406484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cf1a24df664e9faba6fef80874012e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.436833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1066/2094] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:33 2022] DELETE /identity/v3/users/27cf1a24df664e9faba6fef80874012e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:33.438976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.442376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.460472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:33.496436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797426-2e9b-4557-946e-d09be8e9faaf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.579937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.580807 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.581145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.581429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] PATH_INFO: `/v3/users/b9a718b3900948b99b7cdc5e5adae1fa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.583319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a718b3900948b99b7cdc5e5adae1fa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.585778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.593336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d985ee-f364-4f10-b419-7e24f12ffe16 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.600526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.601818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.603324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.603851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] PATH_INFO: `/v3/users/4bbea3a8c41f42a797d8688dff0e59ee` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.605684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbea3a8c41f42a797d8688dff0e59ee)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.608765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.667874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a718b3900948b99b7cdc5e5adae1fa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.668663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a718b3900948b99b7cdc5e5adae1fa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.669357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a718b3900948b99b7cdc5e5adae1fa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.679764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a718b3900948b99b7cdc5e5adae1fa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.704668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbea3a8c41f42a797d8688dff0e59ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.705432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a718b3900948b99b7cdc5e5adae1fa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.724542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1029/2095] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:33 2022] DELETE /identity/v3/users/b9a718b3900948b99b7cdc5e5adae1fa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:33.725776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.728755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.734425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbea3a8c41f42a797d8688dff0e59ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.735243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbea3a8c41f42a797d8688dff0e59ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.748698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbea3a8c41f42a797d8688dff0e59ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.749517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-affe6765-803d-4c9d-9925-c71dab2de1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbea3a8c41f42a797d8688dff0e59ee'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:33.773801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1067/2096] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:33 2022] DELETE /identity/v3/users/4bbea3a8c41f42a797d8688dff0e59ee => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:33.775736 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.776030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.776308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.814507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:33.819732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.839779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8ce26-2645-45a5-b7ec-39ddb81ba2eb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.857366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:33.904922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:33.952710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1068/2097] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:33.958134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:33.959718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:33.970723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.971412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:33.971699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:33.971975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:33.972720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:33.976803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:33.990369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d63ed-104d-4fbf-8289-b719eff35ef0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:33.999199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:33.999989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.000337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.000984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] PATH_INFO: `/v3/projects/06edf789e8cb4ef89a0c40df38105b3e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.003565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06edf789e8cb4ef89a0c40df38105b3e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.008688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.028251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1030/2098] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:33 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:34.028251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.033767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.084061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06edf789e8cb4ef89a0c40df38105b3e', 'request_id': 'req-fa3eaeca-146a-4510-87df-6540c44a0a73'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.092220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06edf789e8cb4ef89a0c40df38105b3e', 'request_id': 'req-fa3eaeca-146a-4510-87df-6540c44a0a73'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.109046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06edf789e8cb4ef89a0c40df38105b3e', 'request_id': 'req-fa3eaeca-146a-4510-87df-6540c44a0a73'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.111882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45604cf-72a8-472f-8b67-96d447eb2d0e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.124672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] The token cache is being invalidate because project 06edf789e8cb4ef89a0c40df38105b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:34.124991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.125743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.127535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1069/2099] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:33 2022] DELETE /identity/v3/projects/06edf789e8cb4ef89a0c40df38105b3e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:34.129557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.131213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.202641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.203811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.204087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.204661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.207384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.248717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eaeca-146a-4510-87df-6540c44a0a73 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.255957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.256633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.256924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.257205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.257976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.259593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b64c1-6c06-4815-90ff-5f2b56ea0a8f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.271390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1070/2100] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:34.272553 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.272868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.273149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.291410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.293024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.294385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:34.295623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.304342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1071/2101] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:34.304514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1031/2102] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:34.305352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.306611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.319462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.321931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f010a-7441-468b-b0b8-0c3e83ae09f8 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.327253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.329014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.329014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.329014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] PATH_INFO: `/v3/projects/3a0b486633034b7db83a5a2e0534ac05` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.329721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b486633034b7db83a5a2e0534ac05)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.332960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.333099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448644f-4f05-496f-8fe6-d11c11207da3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.335053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:34.338217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.338791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.339040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.339436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.340275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.342657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dfdd4-3cee-4775-9d82-1683bfc78d80 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.355454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1072/2103] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:34.360273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30414ef-be35-4911-ac5c-7dbebd7404bf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.360618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30414ef-be35-4911-ac5c-7dbebd7404bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.362318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30414ef-be35-4911-ac5c-7dbebd7404bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.388155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b30414ef-be35-4911-ac5c-7dbebd7404bf None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:34.389777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b30414ef-be35-4911-ac5c-7dbebd7404bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.419049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b486633034b7db83a5a2e0534ac05', 'request_id': 'req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.420758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b486633034b7db83a5a2e0534ac05', 'request_id': 'req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.430744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b486633034b7db83a5a2e0534ac05', 'request_id': 'req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.451602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] The token cache is being invalidate because project 3a0b486633034b7db83a5a2e0534ac05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:34.452280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.453172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:34.455977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1032/2104] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:34 2022] DELETE /identity/v3/projects/3a0b486633034b7db83a5a2e0534ac05 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:34.457283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.466395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.468690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:34.505513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1073/2105] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:34.509333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.509990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.512794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.552331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:34.553647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.579063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1074/2106] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:34.580596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.603138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3601-3ae7-4f0f-94d9-9ff9a8c5cc4b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.604667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c92f-b179-4964-9f54-6bc207949a97 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.614570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.615441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.616071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.616384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.617043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.617551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] PATH_INFO: `/v3/projects/b9593e6b01c742049fbc60e9a0370164/users/b49a461387524823acac7cd4459a7814/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.619983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.620304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.621114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:34.626700 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.631592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb8a8-b371-44bc-b1f7-72b057e4cf62 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.656621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1075/2107] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:34.660859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b1-63fb-4d1e-b3cd-91816d02517a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.661458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b1-63fb-4d1e-b3cd-91816d02517a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.661952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c4b1-63fb-4d1e-b3cd-91816d02517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.672590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9593e6b01c742049fbc60e9a0370164, user_id=b49a461387524823acac7cd4459a7814, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.675506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.692791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6c22c4b1-63fb-4d1e-b3cd-91816d02517a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:34.694644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6c22c4b1-63fb-4d1e-b3cd-91816d02517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.709319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1033/2108] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:34 2022] PUT /identity/v3/projects/b9593e6b01c742049fbc60e9a0370164/users/b49a461387524823acac7cd4459a7814/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:34.710745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.808419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1076/2109] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:34.814205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.815363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.815682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.855008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] MFA Rules not processed for user `b49a461387524823acac7cd4459a7814`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:34.856496 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:34.857902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43925e-6aed-44f5-9e12-10e542dd3213 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:34.867820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:34.868688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:34.868983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:34.869262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:34.870209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:34.872519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:34.901838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:34.927013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1034/2110] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:34.927013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:34.999669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1077/2111] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:35.001504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.020205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a459-1170-4b3f-a608-7e1d294c4a50 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.021251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32efd4-4eac-44b0-8e2f-df41db456022 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.027201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.027483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.027812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.028095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.028208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.028362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.028456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.028715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.029172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.029392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:35.029698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.031071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.031768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.049611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1035/2112] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:35.054591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.068636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1078/2113] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:34 2022] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.068636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.074833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5fafc-423e-43ea-8c1f-9dfe96cfd678 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.080003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.081116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31803d-52c4-45b4-bdc5-158746a4adf7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.082405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.083719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.083719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.085289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.088391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.089859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.091679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.091679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.091679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.092674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.094968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.141139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1079/2114] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.142031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.144937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.152125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1036/2115] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.152125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.176181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:35.235025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc5c9-3f42-4407-bb64-e8136a3ca6a6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.236492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d251e-6ca9-4309-a8bf-34f361e2a570 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.240470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.241351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.241578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.241701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.241966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.242251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.242557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.242664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.242852 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] PATH_INFO: `/v3/projects/f337e4081bb74f19b07dd0a59ab50e71` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.244009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f337e4081bb74f19b07dd0a59ab50e71)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.244181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.245999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.259072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1037/2116] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.260111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.271154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310226f-2111-4b7d-8fee-3dce6d0af9b5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.277579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.278223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.278598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.279020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.279670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.282417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.308629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1038/2117] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.308819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f337e4081bb74f19b07dd0a59ab50e71', 'request_id': 'req-00225c00-3470-429e-82f2-6b3b8090e402'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:35.309243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.312877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f337e4081bb74f19b07dd0a59ab50e71', 'request_id': 'req-00225c00-3470-429e-82f2-6b3b8090e402'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:35.318993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04719236-5cd6-4c7e-b60f-513ffb705473 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.322662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f337e4081bb74f19b07dd0a59ab50e71', 'request_id': 'req-00225c00-3470-429e-82f2-6b3b8090e402'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:35.335225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] The token cache is being invalidate because project f337e4081bb74f19b07dd0a59ab50e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:35.335822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:35.336608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:35.340703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1080/2118] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:35 2022] DELETE /identity/v3/projects/f337e4081bb74f19b07dd0a59ab50e71 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:35.340703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.342081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.375573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:35.391114 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.391755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.392536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.392855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.393527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.395925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.422846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225c00-3470-429e-82f2-6b3b8090e402 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.428056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.428350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1039/2119] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.428833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.429094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.429288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.429385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.430011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.431042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.431627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6cb61-47ff-42ed-ab27-d37d025c6796 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.442731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914c11-c7ba-4918-bc78-28fc851d12c9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.446079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1081/2120] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.446079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.446079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.446079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.450223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.450929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.451262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.451615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.452326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.454005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.469680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1040/2121] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.469971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:35.470660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.471169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.473000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.480315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1082/2122] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:35.485657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.487018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549c37-5feb-40c4-8caf-721d3d6af5dc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.492872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.493765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.494042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.494314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.494958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.496434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e37f1-b497-4a82-92bf-517a12f949ad None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.496592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.501625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.504114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.504469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.504848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] PATH_INFO: `/v3/projects/1ae506dffe424f8a8e7f38effc66a9bd/users/71a060fa3fc24f6ca6fb75a2c241fe62/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.511707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1041/2123] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.512653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.521737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae506dffe424f8a8e7f38effc66a9bd, user_id=71a060fa3fc24f6ca6fb75a2c241fe62, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.523446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad042-b6a4-4831-88c6-3a3466fbfec8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.524622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c9b0-5726-4831-8a42-e7b8c1d4f5f0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.528223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.529089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.529444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.529718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.530556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.532496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.541328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1083/2124] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:35 2022] PUT /identity/v3/projects/1ae506dffe424f8a8e7f38effc66a9bd/users/71a060fa3fc24f6ca6fb75a2c241fe62/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:35.547902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.547902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.547902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.548148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1042/2125] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.548148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.560385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc2fd4-7006-4d04-b311-6a2ad937a7ef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.571054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:35.572459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.583380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:35.628867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.629791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.630223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.630674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] PATH_INFO: `/v3/projects/6f116b1e24984b30927d939816d6049a/users/1c270f7c75f442d99f29233b43952b9b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.642954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1084/2126] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:35.647397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.653076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f116b1e24984b30927d939816d6049a, user_id=1c270f7c75f442d99f29233b43952b9b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.655925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a03a-2ff7-4f96-ace6-bd48b866f1f1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.657655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0bfa-f332-4ebc-9c7a-bb54396db108 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.663177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.663935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.664244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.664546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] PATH_INFO: `/v3/projects/d3ced7b326474fec8b3e82f9fe5ce62e/users/95982d339d70443ebc8b949f588f5955/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.672147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1043/2127] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:35 2022] PUT /identity/v3/projects/6f116b1e24984b30927d939816d6049a/users/1c270f7c75f442d99f29233b43952b9b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:35.676586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.676874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.677145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.684051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ced7b326474fec8b3e82f9fe5ce62e, user_id=95982d339d70443ebc8b949f588f5955, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.686862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.702150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1085/2128] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:35 2022] PUT /identity/v3/projects/d3ced7b326474fec8b3e82f9fe5ce62e/users/95982d339d70443ebc8b949f588f5955/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:35.702910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.719344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] MFA Rules not processed for user `71a060fa3fc24f6ca6fb75a2c241fe62`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:35.720697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.789730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516d2-4420-474b-aa93-cfb674b8bf94 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.795089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.795772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.796130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.796458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.797196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:35.797567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.799223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84640c1d-e202-4ae9-9a4d-717a995d042b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.802046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1044/2129] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:35.802046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.811406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1086/2130] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:35.812759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.813101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.813429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.814266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbc4dc-9f5d-419b-9dc9-510c4d5467fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.821059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.821727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.822043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.822319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.823527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.824787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.838006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1045/2131] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:35.841662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.845371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] MFA Rules not processed for user `95982d339d70443ebc8b949f588f5955`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:35.846576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:35.853738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9d84f-81da-4187-a904-31b3bb562e4f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.858823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.859430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.859714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.859988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.860681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.862575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:35.867380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:35.896422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1046/2132] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:35.897081 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.932150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1087/2133] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:35.933507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:35.948264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d6806-9ef8-4c11-80e7-010aaa33707b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.962251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:35.968127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac005a-25df-45bd-96dc-9d252401f474 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:35.973884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:35.974794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:35.975082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:35.975356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:35.976025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:35.978225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.020794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1047/2134] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:35 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:36.020794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.029791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.030632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.030979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.031404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] PATH_INFO: `/v3/projects/6f116b1e24984b30927d939816d6049a/users/1c270f7c75f442d99f29233b43952b9b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.034518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f116b1e24984b30927d939816d6049a, user_id=1c270f7c75f442d99f29233b43952b9b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.038278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.054970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1088/2135] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:35 2022] PUT /identity/v3/projects/6f116b1e24984b30927d939816d6049a/users/1c270f7c75f442d99f29233b43952b9b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:36.055886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.145943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258da57-483e-43ab-b2cd-d01ad84b4b62 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.156277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188d703-440b-4095-869c-c58df6dee766 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.160924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.161566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.161851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.162184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.162777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.163544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.164247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.164697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.164866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.165637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.167372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.170299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207fae-1192-4200-9eec-f07241f5675f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.212156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1089/2136] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:36 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:36.213150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.219124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1048/2137] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:36 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:36.221495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.223376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.225481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.281848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] MFA Rules not processed for user `1c270f7c75f442d99f29233b43952b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:36.283699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:36.323543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6315-b3a7-4225-8c3b-51765a9e273f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.334019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.336141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.336805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.337042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.339127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.340929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.374501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:36.392966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1090/2138] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:36 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:36.392966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.403944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594a64-ce6a-4531-9eb6-6140c2550198 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.408799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.409576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.409734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.410548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.411177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.415004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.417302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1049/2139] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:36.418606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.439077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466835-c56d-4409-9e28-5eaeeb8b5184 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.442933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1091/2140] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:36 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:36.444733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.445365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.445558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.445656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.446140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.446806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.448429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.461421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1050/2141] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:36.461892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.462003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419649a-0a85-4b0c-aff5-cfa24e83664d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.463589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:36.472041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.472924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.473211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.473488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.474754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.477237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.479016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:36.500346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1092/2142] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:36.502452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.516868 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa4eb-880e-42f1-8fb2-14c1aaf55de4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.528301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.528955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.529240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.529517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.530168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.531800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.546688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1093/2143] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:36.547846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.553533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720593-0ec7-42bb-96a7-a48d27e154c5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.557252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.558051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.558332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.558604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.561019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:36.562603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac919e4e-dbdb-4450-8809-7f89fe1c33c2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.572627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.572627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.580853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.581205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] PATH_INFO: `/v3/projects/03f81c65906e4a14b19d7b2202bfc49e/users/37050a9c60454a38944daa5f5f58d127/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.606544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f81c65906e4a14b19d7b2202bfc49e, user_id=37050a9c60454a38944daa5f5f58d127, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.610084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.625148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1094/2144] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:36 2022] PUT /identity/v3/projects/03f81c65906e4a14b19d7b2202bfc49e/users/37050a9c60454a38944daa5f5f58d127/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:36.630122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.662456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.664364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.683185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1051/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:36.685498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.701647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b113574-d6db-4a4a-b644-d60548ddfd2c service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.779918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40224-aabd-4d5e-8e25-2a9fdd190c2f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.787516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.788271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.788558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.788966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.789617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.791220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.805382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1095/2146] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:36.806213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.807032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.810562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.810562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.810562 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] PATH_INFO: `/v3/projects/1d1b6562b44c47d0ba97364579079c43/users/304e6826cb7048faad260a8a5c073318/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.835635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa71bb7-8468-434c-b0f3-b45978f24901 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.842538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1b6562b44c47d0ba97364579079c43, user_id=304e6826cb7048faad260a8a5c073318, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.843286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.845457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.847731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.847916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.848023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.848713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:36.850369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:36.865741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1096/2147] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:36.867671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.880542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cab3-ef12-4361-9abd-1899966cf851 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.883278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1052/2148] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:36 2022] PUT /identity/v3/projects/1d1b6562b44c47d0ba97364579079c43/users/304e6826cb7048faad260a8a5c073318/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:36.884198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:36.909611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:36.980876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.981561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.981851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.982122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] PATH_INFO: `/v3/projects/6ebe20f6758248b48de61f563f6be48c/users/3ce733eb44f84ef4b3611cc0cc971ac0/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.989425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360404e4-a1a6-412a-914d-19ec4cf005a8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:36.995101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:36.996016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:36.996400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:36.997011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] PATH_INFO: `/v3/projects/03f81c65906e4a14b19d7b2202bfc49e/users/37050a9c60454a38944daa5f5f58d127/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:36.999232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f81c65906e4a14b19d7b2202bfc49e, user_id=37050a9c60454a38944daa5f5f58d127, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.002817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.009186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebe20f6758248b48de61f563f6be48c, user_id=3ce733eb44f84ef4b3611cc0cc971ac0, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.012230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169927b3-63e9-46b5-8325-397b8271e17d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.018490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1053/2149] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:36 2022] PUT /identity/v3/projects/03f81c65906e4a14b19d7b2202bfc49e/users/37050a9c60454a38944daa5f5f58d127/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:37.020277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.035926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1097/2150] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:36 2022] PUT /identity/v3/projects/6ebe20f6758248b48de61f563f6be48c/users/3ce733eb44f84ef4b3611cc0cc971ac0/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:37.037395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6df3f-f9b3-4a5c-89d1-abe43280d97d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.037790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6df3f-f9b3-4a5c-89d1-abe43280d97d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.038168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6df3f-f9b3-4a5c-89d1-abe43280d97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.077720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-09b6df3f-f9b3-4a5c-89d1-abe43280d97d None None] MFA Rules not processed for user `37050a9c60454a38944daa5f5f58d127`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:37.079541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-09b6df3f-f9b3-4a5c-89d1-abe43280d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:37.112546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:37.160870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac4c25-1d9e-44a0-8d95-64f21170d4c3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.204048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1098/2151] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:37.205781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.206113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.206390 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.240032 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] MFA Rules not processed for user `3ce733eb44f84ef4b3611cc0cc971ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:37.241154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:37.271674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.272668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.273970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.273970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.273970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.275822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.288511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1054/2152] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:37.289641 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.323911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1099/2153] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:37.325087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.336503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7006-ce0b-4017-be37-ed11d5e51041 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.341692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.342454 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.342878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.343317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] PATH_INFO: `/v3/projects/1d1b6562b44c47d0ba97364579079c43/users/304e6826cb7048faad260a8a5c073318/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.345570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1b6562b44c47d0ba97364579079c43, user_id=304e6826cb7048faad260a8a5c073318, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.348991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.350487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:37.355194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaa6d5-3d6e-4024-9362-74c6c7b38fe8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.361961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1100/2154] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:37 2022] PUT /identity/v3/projects/1d1b6562b44c47d0ba97364579079c43/users/304e6826cb7048faad260a8a5c073318/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:37.374105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.376167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:37.428115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.429690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.430291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.431061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.450419 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2cb1-06be-449f-a010-475ae45f079e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.456254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.457166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.457591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.458467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.516958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.518495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df141c-c50b-4544-a2ff-6791196270a0 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.527303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:37.535953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1055/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:37.535953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.535953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.536510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.543956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.546005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.557759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1101/2156] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:37.590349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] MFA Rules not processed for user `304e6826cb7048faad260a8a5c073318`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:37.590916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.591825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:37.685912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0622-1d36-494f-bd6c-f2bcf71890c4 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.694153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1056/2157] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:37.698918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.699882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.700274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.702291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] PATH_INFO: `/v3/users/71a060fa3fc24f6ca6fb75a2c241fe62` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.704327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a060fa3fc24f6ca6fb75a2c241fe62)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.707997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.713407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:37.725683 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c42fd-e94f-48b5-8360-2a55f02c76e0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:37.738969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:37.740127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.740508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.740940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.754111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:37.756053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4da3a9-3d0c-4d2e-a988-58092781bed6 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:37.784506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1057/2158] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:37.804123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a060fa3fc24f6ca6fb75a2c241fe62'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:37.822787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a060fa3fc24f6ca6fb75a2c241fe62'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:37.824542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a060fa3fc24f6ca6fb75a2c241fe62'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:37.833554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a060fa3fc24f6ca6fb75a2c241fe62'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:37.837460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a060fa3fc24f6ca6fb75a2c241fe62'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:37.864019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1102/2159] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:37 2022] DELETE /identity/v3/users/71a060fa3fc24f6ca6fb75a2c241fe62 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:37.869666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:37.870270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:37.870684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:37.919531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:37.924091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:37.981515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:38.060249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1058/2160] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:38.075773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.077258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:38.193560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a6bd0-5690-4bc9-beb1-8dfbfa9cb876 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.197939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.198557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.198839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.199110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.211077 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.212697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.224200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1103/2161] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:38.445015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.446867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:38.484301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.485773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:38.504425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:38.546916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72036-3aab-4286-92e1-d7b2bbe83e16 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.551412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '304e6826cb7048faad260a8a5c073318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d1b6562b44c47d0ba97364579079c43', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.552534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.552868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.553150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.553810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:38.554118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.555964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.571300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1059/2162] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:38.575559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.589024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cce37-26cf-46c8-8613-9498befd00bb tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.595949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '304e6826cb7048faad260a8a5c073318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d1b6562b44c47d0ba97364579079c43', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.596551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.596896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.597287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.598920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.601080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.620175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682408ad-1a8d-4a19-ba8c-e34661110d57 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.627502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.628186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.628475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.629130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.632213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:38.652612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1060/2163] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:38 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:38.654817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.741938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.743520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.778490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1104/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:38.780492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.788971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ecf9-e400-4c51-976f-a86a10161f5c tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.794746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '304e6826cb7048faad260a8a5c073318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d1b6562b44c47d0ba97364579079c43', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.795475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.795825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.796224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.797074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:38.797186 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:38.797276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.799926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.814857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1061/2165] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:38.846922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ca8f8-a641-4cbc-90a1-42dc642c1dbd service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.885621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:38.899753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ed87-92dc-4f8a-a321-f8836063c18e tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:38.915182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '304e6826cb7048faad260a8a5c073318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d1b6562b44c47d0ba97364579079c43', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.916172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.916619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.916913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] PATH_INFO: `/v3/projects/bc67b157f6e5489cbc292a9065cadff4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.918704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc67b157f6e5489cbc292a9065cadff4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.921802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.932078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:38.933037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:38.934167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:38.934627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] PATH_INFO: `/v3/projects/1ae506dffe424f8a8e7f38effc66a9bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:38.936301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae506dffe424f8a8e7f38effc66a9bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:38.939020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:38.974674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:38.996835 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc67b157f6e5489cbc292a9065cadff4', 'request_id': 'req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.010138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc67b157f6e5489cbc292a9065cadff4', 'request_id': 'req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.014270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae506dffe424f8a8e7f38effc66a9bd', 'request_id': 'req-040d493b-511d-434e-b1e7-f0bf95fd86d2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.018074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc67b157f6e5489cbc292a9065cadff4', 'request_id': 'req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.023184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae506dffe424f8a8e7f38effc66a9bd', 'request_id': 'req-040d493b-511d-434e-b1e7-f0bf95fd86d2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.028886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:39.037000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae506dffe424f8a8e7f38effc66a9bd', 'request_id': 'req-040d493b-511d-434e-b1e7-f0bf95fd86d2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.039122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] The token cache is being invalidate because project bc67b157f6e5489cbc292a9065cadff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:39.039663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.040451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.042221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1062/2166] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:38 2022] DELETE /identity/v3/projects/bc67b157f6e5489cbc292a9065cadff4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:39.061441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] The token cache is being invalidate because project 1ae506dffe424f8a8e7f38effc66a9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:39.061737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.063096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.066195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1105/2167] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:38 2022] DELETE /identity/v3/projects/1ae506dffe424f8a8e7f38effc66a9bd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:39.070185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:39.071664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:39.164526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc058-63ea-488e-9d3c-1ac1a6df6e65 tempest-VolumeQuotaClassesTest-944100109 tempest-VolumeQuotaClassesTest-944100109-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:39.240072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:39.241013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:39.241367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:39.241730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] PATH_INFO: `/v3/users/37050a9c60454a38944daa5f5f58d127` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:39.243331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37050a9c60454a38944daa5f5f58d127)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:39.245686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:39.326622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37050a9c60454a38944daa5f5f58d127'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.328170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37050a9c60454a38944daa5f5f58d127'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.329103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37050a9c60454a38944daa5f5f58d127'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.342344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37050a9c60454a38944daa5f5f58d127'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.363566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:39.378846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37050a9c60454a38944daa5f5f58d127'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.411330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1063/2168] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:39 2022] DELETE /identity/v3/users/37050a9c60454a38944daa5f5f58d127 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:39.498751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:39.501838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:39.527393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d493b-511d-434e-b1e7-f0bf95fd86d2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:39.701063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:39.701727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:39.702008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:39.702287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] PATH_INFO: `/v3/users/95982d339d70443ebc8b949f588f5955` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:39.704142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95982d339d70443ebc8b949f588f5955)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:39.706232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:39.789026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:39.791032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:39.818375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95982d339d70443ebc8b949f588f5955'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.850856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95982d339d70443ebc8b949f588f5955'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.850856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95982d339d70443ebc8b949f588f5955'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.882241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95982d339d70443ebc8b949f588f5955'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.885878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95982d339d70443ebc8b949f588f5955'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:39.897199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d489d-bace-4c01-82bc-ab0b9dafb20e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:39.902029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:39.902678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:39.902968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:39.903208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:39.906175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:39.915968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1106/2169] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:39 2022] DELETE /identity/v3/users/95982d339d70443ebc8b949f588f5955 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:39.920059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:39.921521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.005690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6b0e-0a04-4bc8-99fe-4c7dc71eab82 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.014405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.015047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.015323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.015602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] PATH_INFO: `/v3/projects/03f81c65906e4a14b19d7b2202bfc49e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.017618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f81c65906e4a14b19d7b2202bfc49e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.020378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.033811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:40.036987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.038489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f79c3-77fe-4fc1-85eb-ed80c5b7f601 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.048701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1064/2170] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:40.050643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.050643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.050985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.080307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:40.080800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f81c65906e4a14b19d7b2202bfc49e', 'request_id': 'req-af25958e-94d5-4abf-a55b-e064a6fbbf5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.082106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.089124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f81c65906e4a14b19d7b2202bfc49e', 'request_id': 'req-af25958e-94d5-4abf-a55b-e064a6fbbf5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.099374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f81c65906e4a14b19d7b2202bfc49e', 'request_id': 'req-af25958e-94d5-4abf-a55b-e064a6fbbf5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.113246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] The token cache is being invalidate because project 03f81c65906e4a14b19d7b2202bfc49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:40.113692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.114426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-af25958e-94d5-4abf-a55b-e064a6fbbf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.116165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1107/2171] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:39 2022] DELETE /identity/v3/projects/03f81c65906e4a14b19d7b2202bfc49e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:40.121015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5060-a932-4593-9d35-1b68f9469127 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.121529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5060-a932-4593-9d35-1b68f9469127 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.122818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5060-a932-4593-9d35-1b68f9469127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.149067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4eda5060-a932-4593-9d35-1b68f9469127 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:40.150276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4eda5060-a932-4593-9d35-1b68f9469127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.150875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1065/2172] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:40.160996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1108/2173] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:40.165853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.168195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.169248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.169547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.169832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.190601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:40.192275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.200666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1109/2174] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:40.204837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.208420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:40.214396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88b0fc-fc16-4c42-84fc-695f43eca689 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.219446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.220349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.220349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.220641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.221253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:40.221560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.223690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.239879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1110/2175] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:30:40.240048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94446df-5c29-470c-b6b9-4bbde318d9c3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.240970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.241637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.242238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.242515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.242787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.250883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1de1-640e-4a44-8329-2ae903b12c41 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.252824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.254397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.256215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.256918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.257261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.257606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.258278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.260148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.264808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1066/2176] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:40.303167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1111/2177] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:40.304482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.315228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0a640-49a5-4167-9971-1f523651b602 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.390749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.391770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.392091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.392500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.393255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.395328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.421474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1067/2178] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:40.426246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.436973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a3ea8-02cb-4f3b-8e73-cb6c50c8d137 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.441812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.442521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.442896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.443263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.444024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.445789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.459433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1112/2179] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:40.460629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.470794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b442d15-0441-414c-b333-5538fea4f120 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.476020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.476646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.476926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.477199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.478104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.479719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.490380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1068/2180] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:40.494541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.505153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979028-bd4f-4b4d-bfa3-4cd2bb84b9e2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.510594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.511265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.511554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.511835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] PATH_INFO: `/v3/projects/cb528786d4ee41d990e7964d4f7687c1/users/eb8c48d4d45e43278187293994810b57/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.530292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb528786d4ee41d990e7964d4f7687c1, user_id=eb8c48d4d45e43278187293994810b57, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.533038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10e26-7f9f-4e4b-835d-5ee7e0fa5f89 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.546377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.548075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1113/2181] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:40 2022] PUT /identity/v3/projects/cb528786d4ee41d990e7964d4f7687c1/users/eb8c48d4d45e43278187293994810b57/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:40.548490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.553567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.553875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.554167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.562495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357887a1-16c1-49d5-943f-8928ff493cba admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.578135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:40.579483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.624203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.624976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.625257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.625719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] PATH_INFO: `/v3/projects/d3ced7b326474fec8b3e82f9fe5ce62e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.626872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ced7b326474fec8b3e82f9fe5ce62e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.628910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.643119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1114/2182] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:40.652876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.654405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.677045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:40.679147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ced7b326474fec8b3e82f9fe5ce62e', 'request_id': 'req-822468a4-b6c4-41fe-8410-487d848868ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.686075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ced7b326474fec8b3e82f9fe5ce62e', 'request_id': 'req-822468a4-b6c4-41fe-8410-487d848868ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.688171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:40.693052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ced7b326474fec8b3e82f9fe5ce62e', 'request_id': 'req-822468a4-b6c4-41fe-8410-487d848868ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.707130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] The token cache is being invalidate because project d3ced7b326474fec8b3e82f9fe5ce62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:40.707424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.708102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.709697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1069/2183] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:40 2022] DELETE /identity/v3/projects/d3ced7b326474fec8b3e82f9fe5ce62e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:40.715140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:40.716541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.732589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899f16c-7ed7-4d9d-97a4-772ff45d3b55 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.789334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822468a4-b6c4-41fe-8410-487d848868ab admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:40.792588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.793975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.793975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.794273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:40.794414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.794916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:40.795195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:40.795470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] PATH_INFO: `/v3/users/304e6826cb7048faad260a8a5c073318` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:40.796660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:40.796797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304e6826cb7048faad260a8a5c073318)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.798710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.812668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:40.814131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:40.829194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1115/2184] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:40.868385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304e6826cb7048faad260a8a5c073318'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.869171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304e6826cb7048faad260a8a5c073318'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.869805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304e6826cb7048faad260a8a5c073318'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.881989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304e6826cb7048faad260a8a5c073318'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.901703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-afd73d5f-d0ce-4e9a-9a09-d4eae6e30093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304e6826cb7048faad260a8a5c073318'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:40.921529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1070/2185] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:40 2022] DELETE /identity/v3/users/304e6826cb7048faad260a8a5c073318 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:41.562381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:41.582075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64e5cc-bed5-470c-9f80-11bce228b880 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:41.702098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:41.702943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:41.703423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:41.703739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] PATH_INFO: `/v3/projects/1d1b6562b44c47d0ba97364579079c43` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:41.705001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1b6562b44c47d0ba97364579079c43)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:41.708407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:41.773927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1b6562b44c47d0ba97364579079c43', 'request_id': 'req-e9fc5818-0539-4630-bbfe-276e009d074b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:41.781614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1b6562b44c47d0ba97364579079c43', 'request_id': 'req-e9fc5818-0539-4630-bbfe-276e009d074b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:41.794064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1b6562b44c47d0ba97364579079c43', 'request_id': 'req-e9fc5818-0539-4630-bbfe-276e009d074b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:41.809918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] The token cache is being invalidate because project 1d1b6562b44c47d0ba97364579079c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:41.810242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:41.810938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9fc5818-0539-4630-bbfe-276e009d074b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:41.812596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1116/2186] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:41 2022] DELETE /identity/v3/projects/1d1b6562b44c47d0ba97364579079c43 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:41.818050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf27b8-99d0-4c72-bd96-6bd36c0cc309 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:41.818916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf27b8-99d0-4c72-bd96-6bd36c0cc309 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:41.819365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf27b8-99d0-4c72-bd96-6bd36c0cc309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:41.840888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1aaf27b8-99d0-4c72-bd96-6bd36c0cc309 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:41.842224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1aaf27b8-99d0-4c72-bd96-6bd36c0cc309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:41.913733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1071/2187] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:41.922301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:41.922301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:41.922565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:41.937997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:41.944228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:41.945677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:41.957884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:41.958483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:41.958777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:41.966557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1117/2188] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:41.967947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:41.969613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:41.981506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73164a-db37-435f-b6c8-aee57479d4e2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:41.987190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:41.988587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:41.989093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:41.989577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:41.990711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:41.991268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:41.993373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:41.999805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] MFA Rules not processed for user `eb8c48d4d45e43278187293994810b57`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:42.001087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:42.007180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1118/2189] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:30:42.011859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.029784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4d46-4e5d-4f68-a20d-4e8bd383147f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.035430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.036225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.036652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.036939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.037601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.040357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.115687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1119/2190] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:42.121173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.138282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1072/2191] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:42.142695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.145745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:42.166804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738174c-0546-4ca2-b20b-5343314676f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.235840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0566a-96eb-4943-aa6d-0b6037ec23c2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.243086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.243834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.244290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.244755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.245885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.247820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.255364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.256204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.256491 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.256801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.257754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.259584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.274410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1120/2192] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:42.278582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.292195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6b3a-1056-4bbf-80e6-4a4db3f0008f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.298001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.298648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.299396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.299845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.301351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.303467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.316463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1073/2193] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:42.316670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1121/2194] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:42.317565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.320262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.333154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448667d-d74e-4008-a3a4-bc94afb8c04c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.385281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739b8a-e9f2-40ba-8fa8-36bb4f058ff1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.390570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.391191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.391740 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.392027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.392938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.395899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.396626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.397262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.397662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.397940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.399202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.400302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.414212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1122/2195] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:42.418269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.419630 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1074/2196] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:42.425735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.435387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c068fe-487c-479b-885d-3bb1603d0d3b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.445221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05107-7f11-4c81-b4cf-09647027c8ca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.445470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.445470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.445470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.445470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] PATH_INFO: `/v3/projects/dd84d2b068f34a828732f9e7f9517194/users/edd97889f03844d99b7c2b0edf9aa966/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.449668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.450519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.450812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.451212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.452105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.454219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.459047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:42.468904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd84d2b068f34a828732f9e7f9517194, user_id=edd97889f03844d99b7c2b0edf9aa966, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.473628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b7f5d-ede4-4e29-867e-e20625e31ffe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.476246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1075/2197] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:42.477817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.490149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc133a3f-8733-48f0-a919-9d5ac0a447f9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.511487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1123/2198] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:42 2022] PUT /identity/v3/projects/dd84d2b068f34a828732f9e7f9517194/users/edd97889f03844d99b7c2b0edf9aa966/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:42.524251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.524781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.525084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.557461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] MFA Rules not processed for user `edd97889f03844d99b7c2b0edf9aa966`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:42.559382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:42.564633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:42.577031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.577714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.578023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.578307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] PATH_INFO: `/v3/projects/5959285bcbcf4204a1a65ba7dea531ee/users/7059f40b2e274b64984a7db168546393/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.608271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5959285bcbcf4204a1a65ba7dea531ee, user_id=7059f40b2e274b64984a7db168546393, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.608271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.614361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1076/2199] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:42 2022] PUT /identity/v3/projects/5959285bcbcf4204a1a65ba7dea531ee/users/7059f40b2e274b64984a7db168546393/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:42.618289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.639990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1124/2200] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:42.644814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.659312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9ac5-c0da-4b36-83a0-c7627d5d3163 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.681708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0220-f7f3-4599-b75f-9852e81e638f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.691324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.692152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.692422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.692726 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.693374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.694964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.705470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1077/2201] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:42.710206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.720191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d896072-b61a-4933-abec-1751536750b7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.720655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.721296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.721576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.721884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.722770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.724710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.725115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.725844 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.726178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.726495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] PATH_INFO: `/v3/projects/5959285bcbcf4204a1a65ba7dea531ee/users/7059f40b2e274b64984a7db168546393/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.729128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5959285bcbcf4204a1a65ba7dea531ee, user_id=7059f40b2e274b64984a7db168546393, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.732366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.743803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1078/2202] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:42 2022] PUT /identity/v3/projects/5959285bcbcf4204a1a65ba7dea531ee/users/7059f40b2e274b64984a7db168546393/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:42.760642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1125/2203] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:42.763789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:42.862460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d241-54de-4142-ad51-dac2224314cf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:42.874643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:42.961162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:42.961922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:42.962323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:42.962716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:42.963604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:42.965611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:42.989651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1079/2204] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:42 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:42.993475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.006465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765f7b2-b48f-477b-b245-5e56c606acf4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.011726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.012339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.012644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.013070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.013560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.015657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.041122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1126/2205] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:43.045233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.057702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080070e8-bb49-471c-a327-b164d4065ba4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.063002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.063674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.063951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.064220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] PATH_INFO: `/v3/projects/8b91f0000d494b9fbd69a8b990ba4438/users/57257d47808746c2b039253c5cf23075/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.083205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91f0000d494b9fbd69a8b990ba4438, user_id=57257d47808746c2b039253c5cf23075, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.086027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.115287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1080/2206] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:43 2022] PUT /identity/v3/projects/8b91f0000d494b9fbd69a8b990ba4438/users/57257d47808746c2b039253c5cf23075/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:43.119418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.133306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43df139-d012-4516-8f17-9ca3bf2ce946 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.236258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.236924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.238209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.238499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.252813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.252813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee7b0c-0ebe-4824-b974-946c8bf7cd3c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.252813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1127/2207] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:43.257721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.268498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0a3bf-fbd6-4eb3-aeda-531114bad848 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.275932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.275932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.276241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.276636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] PATH_INFO: `/v3/projects/8b91f0000d494b9fbd69a8b990ba4438/users/57257d47808746c2b039253c5cf23075/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.278745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91f0000d494b9fbd69a8b990ba4438, user_id=57257d47808746c2b039253c5cf23075, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.281706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.295206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1081/2208] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:43 2022] PUT /identity/v3/projects/8b91f0000d494b9fbd69a8b990ba4438/users/57257d47808746c2b039253c5cf23075/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:43.305921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b2be-ed49-4017-a0a6-3c7eae4f1982 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.306168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b2be-ed49-4017-a0a6-3c7eae4f1982 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.306446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069b2be-ed49-4017-a0a6-3c7eae4f1982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.336727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9069b2be-ed49-4017-a0a6-3c7eae4f1982 None None] MFA Rules not processed for user `57257d47808746c2b039253c5cf23075`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:43.337953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9069b2be-ed49-4017-a0a6-3c7eae4f1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:43.342779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:43.432799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1128/2209] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:43.449661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.452086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:43.533363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb03dac-457e-42dd-9fb1-a59c86f981b9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.533651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb03dac-457e-42dd-9fb1-a59c86f981b9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.533933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb03dac-457e-42dd-9fb1-a59c86f981b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.576078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ddee-1d3e-4f1c-8215-ae175c4ba9c0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.580836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.581150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5bb03dac-457e-42dd-9fb1-a59c86f981b9 None None] MFA Rules not processed for user `7059f40b2e274b64984a7db168546393`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:43.582425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5bb03dac-457e-42dd-9fb1-a59c86f981b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:43.582822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.583270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.583698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.594793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.596432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.610723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1082/2210] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:43.690394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.701560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1e842-6aa9-4a17-99b8-46b832d8d26b service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:43.707571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:43.708804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.709113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.709390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.723213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1129/2211] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:43.735356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:43.736519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:43.737201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:43.771488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] MFA Rules not processed for user `eb8c48d4d45e43278187293994810b57`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:43.772767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:43.856875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:43.858671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:43.861412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1130/2212] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:43.870331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1083/2213] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:43.872823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:43.874441 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:43.925674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:44.000981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51d33-4e5c-48c0-8608-45a6b2122943 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:44.007498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:44.008121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:44.008403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:44.008711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:44.025230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:44.027269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d352a3f-ed16-46d6-ad1b-5e6accbe83d8 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:44.040067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1131/2214] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:44.373442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:44.374967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:44.382728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:44.447259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c677-dd0b-40b1-9abc-5669a296a52f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:44.451820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:44.452472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:44.452780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:44.453055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] PATH_INFO: `/v3/users/fe67952655044f53b42aa6cf13d336d0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:44.454207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe67952655044f53b42aa6cf13d336d0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:44.456178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:44.508968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe67952655044f53b42aa6cf13d336d0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:44.509597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe67952655044f53b42aa6cf13d336d0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:44.510200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe67952655044f53b42aa6cf13d336d0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:44.518438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe67952655044f53b42aa6cf13d336d0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:44.532391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe67952655044f53b42aa6cf13d336d0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:44.546792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1084/2215] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:44 2022] DELETE /identity/v3/users/fe67952655044f53b42aa6cf13d336d0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:44.552035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:44.552251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:44.552531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:44.575927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:44.577230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:44.650641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1132/2216] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:44.661684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:44.663177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:44.730948 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c40b5-5d97-409b-8824-309e7ce08e6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:44.735173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:44.736036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:44.736379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:44.736688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:44.747383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:44.749000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:44.759089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1085/2217] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:30:45.158130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:45.160076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:45.174163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985847bf-0891-496d-9bc7-d2735da02773 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:45.179677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:45.180381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:45.181374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:45.181856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] PATH_INFO: `/v3/projects/4ac642f2046c42c992391ca09663249f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:45.183098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac642f2046c42c992391ca09663249f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:45.185470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:45.249377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac642f2046c42c992391ca09663249f', 'request_id': 'req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.255643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac642f2046c42c992391ca09663249f', 'request_id': 'req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.263401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac642f2046c42c992391ca09663249f', 'request_id': 'req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.278122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] The token cache is being invalidate because project 4ac642f2046c42c992391ca09663249f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:45.278665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.279435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.282038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1133/2218] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:45 2022] DELETE /identity/v3/projects/4ac642f2046c42c992391ca09663249f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:45.286364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:45.297319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ff1d-0033-40d4-81f1-a38b9eadb72f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:45.325834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:45.365510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:45.366151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:45.366437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:45.366717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] PATH_INFO: `/v3/users/b49a461387524823acac7cd4459a7814` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:45.367874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49a461387524823acac7cd4459a7814)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:45.369841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:45.433983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49a461387524823acac7cd4459a7814'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.434781 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49a461387524823acac7cd4459a7814'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.435952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49a461387524823acac7cd4459a7814'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.445344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49a461387524823acac7cd4459a7814'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.463530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49a461387524823acac7cd4459a7814'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.490474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1086/2219] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:45 2022] DELETE /identity/v3/users/b49a461387524823acac7cd4459a7814 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:45.793860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:45.795439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:45.809491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae159-7b47-4e77-90a6-ef6b8e4904f9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:45.855996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:45.874879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:45.875652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:45.876012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:45.876377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] PATH_INFO: `/v3/projects/b9593e6b01c742049fbc60e9a0370164` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:45.877612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9593e6b01c742049fbc60e9a0370164)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:45.880121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:45.929524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9593e6b01c742049fbc60e9a0370164', 'request_id': 'req-9512a047-44be-453e-99c1-48420c451eec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.936136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9593e6b01c742049fbc60e9a0370164', 'request_id': 'req-9512a047-44be-453e-99c1-48420c451eec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.944116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9593e6b01c742049fbc60e9a0370164', 'request_id': 'req-9512a047-44be-453e-99c1-48420c451eec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.956916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] The token cache is being invalidate because project b9593e6b01c742049fbc60e9a0370164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:45.957217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.957983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:45.959933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1134/2220] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:45 2022] DELETE /identity/v3/projects/b9593e6b01c742049fbc60e9a0370164 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:45.965175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:45.969360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:45.987513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2366-7d55-4d6d-9f23-33d356dfb38d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:46.056990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:46.056990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.056990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.056990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] PATH_INFO: `/v3/users/1c270f7c75f442d99f29233b43952b9b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.057934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c270f7c75f442d99f29233b43952b9b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:46.061264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:46.113069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c270f7c75f442d99f29233b43952b9b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.113969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c270f7c75f442d99f29233b43952b9b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.114694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c270f7c75f442d99f29233b43952b9b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.115917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:46.125059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c270f7c75f442d99f29233b43952b9b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.142284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e5028afa-8ada-491d-9322-bb8bb8b23b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c270f7c75f442d99f29233b43952b9b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.170534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1087/2221] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:45 2022] DELETE /identity/v3/users/1c270f7c75f442d99f29233b43952b9b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:46.626159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:46.627877 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:46.643309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512a047-44be-453e-99c1-48420c451eec admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:46.703248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:46.703923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.704202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.704471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] PATH_INFO: `/v3/projects/6f116b1e24984b30927d939816d6049a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.705633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f116b1e24984b30927d939816d6049a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:46.708084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:46.759443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f116b1e24984b30927d939816d6049a', 'request_id': 'req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.771560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f116b1e24984b30927d939816d6049a', 'request_id': 'req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.779322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f116b1e24984b30927d939816d6049a', 'request_id': 'req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.788638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:46.793888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] The token cache is being invalidate because project 6f116b1e24984b30927d939816d6049a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:46.794455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.795727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-413f7e6c-3a42-4d0e-b5a3-4aae18a2a717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:46.797563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1135/2222] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:46 2022] DELETE /identity/v3/projects/6f116b1e24984b30927d939816d6049a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:46.803013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.803488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.803488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.824963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:46.826364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:46.889565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1088/2223] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:46.898192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.898490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.898773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.920331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:46.921610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:46.930224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1136/2224] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:46.934559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:46.944674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307789-f3e9-4ef9-8227-372ec804fc11 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:46.949359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:46.950011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.950349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.950619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.951524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:46.951831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:46.953700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:46.969318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1089/2225] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:46.974035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:46.983418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc1e7d-18d6-4fc6-9ac6-987a5e33a4b9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:46.988545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:46.989293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:46.989605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:46.989876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:46.990503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:46.992363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.023293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1137/2226] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:46 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:47.027394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.038167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ab45-ebbb-40aa-853a-513d0b536688 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.096725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.097387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.097853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.098028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.098702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.100637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.122797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1090/2227] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:47 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:47.127141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.138071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e1608-6888-4130-95ea-8ba2da65bf6c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.142909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.143576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.144455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.144797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.145473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.147153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.158823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1138/2228] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:47.163516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.174162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac8ae4-b19b-4c3e-ac29-c66668e5e205 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.179236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.179880 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.180162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.180437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.181121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.182811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55fb32-682c-47ae-b204-a794818d326d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.199778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1091/2229] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:47.203573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.216339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221a97c-fc74-41e0-8bc4-04cf2832160b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.223944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.224708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.225029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.225331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] PATH_INFO: `/v3/projects/9a474700b12e4f38a3b25464aab5e331/users/8b3b286a43e147bab49bcb660ea38694/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.242325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a474700b12e4f38a3b25464aab5e331, user_id=8b3b286a43e147bab49bcb660ea38694, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.245053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.257952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1139/2230] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:47 2022] PUT /identity/v3/projects/9a474700b12e4f38a3b25464aab5e331/users/8b3b286a43e147bab49bcb660ea38694/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:47.327955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.328342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.328762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.358213 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] MFA Rules not processed for user `8b3b286a43e147bab49bcb660ea38694`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:47.359414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:47.378418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:47.439395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1092/2231] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:47.451921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.453614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:47.519926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.521975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:47.544991 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650f1f3-0a0e-430a-acb3-fffdffd74ba8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.549846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.550669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.550943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.551225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.561332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.562599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9892b-fead-469d-bb28-79bcff6ab3f1 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.573978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1140/2232] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:47.605428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f087c-59ae-4494-9184-053a4f3a3c19 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.618869 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.619761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.620278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.620670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] PATH_INFO: `/v3/users/edd97889f03844d99b7c2b0edf9aa966` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.622101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd97889f03844d99b7c2b0edf9aa966)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:47.624618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:47.709293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd97889f03844d99b7c2b0edf9aa966'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:47.718451 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd97889f03844d99b7c2b0edf9aa966'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:47.719360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd97889f03844d99b7c2b0edf9aa966'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:47.728698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd97889f03844d99b7c2b0edf9aa966'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:47.761590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd97889f03844d99b7c2b0edf9aa966'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:47.801258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1093/2233] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:47 2022] DELETE /identity/v3/users/edd97889f03844d99b7c2b0edf9aa966 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:47.810107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.810623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.811049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:47.834057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:47.835398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:47.914495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1141/2234] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:47.924599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:47.926055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:47.974380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:47.992770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64bf1-0e65-476e-8707-12e960d9d9ee admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:47.996664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:47.997280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:47.997558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:47.997832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:48.008144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:48.010203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:48.025581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1094/2235] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:48.374863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:48.376760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:48.390095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52174-77c8-422a-bcc6-ba53dd565609 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:48.395185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:48.396198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:48.396761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:48.397253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] PATH_INFO: `/v3/projects/dd84d2b068f34a828732f9e7f9517194` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:48.399551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd84d2b068f34a828732f9e7f9517194)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:48.402236 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:48.466943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:48.482893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd84d2b068f34a828732f9e7f9517194', 'request_id': 'req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.496800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd84d2b068f34a828732f9e7f9517194', 'request_id': 'req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.506754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd84d2b068f34a828732f9e7f9517194', 'request_id': 'req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.519339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] The token cache is being invalidate because project dd84d2b068f34a828732f9e7f9517194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:48.519663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.520316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.521817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1142/2236] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:48 2022] DELETE /identity/v3/projects/dd84d2b068f34a828732f9e7f9517194 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:48.525917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:48.536984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05a78-b4f7-419f-81db-ac82465ee1ae service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:48.617723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:48.618381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:48.618805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:48.619135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] PATH_INFO: `/v3/users/57257d47808746c2b039253c5cf23075` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:48.621573 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57257d47808746c2b039253c5cf23075)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:48.622530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:48.676236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57257d47808746c2b039253c5cf23075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.676929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57257d47808746c2b039253c5cf23075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.677563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57257d47808746c2b039253c5cf23075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.686607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57257d47808746c2b039253c5cf23075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.701344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57257d47808746c2b039253c5cf23075'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:48.720932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1095/2237] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:48 2022] DELETE /identity/v3/users/57257d47808746c2b039253c5cf23075 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:48.957348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:48.958817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:48.975734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe4232-6706-4d24-be5f-5ca1934b7ed3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.064024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.064741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.065014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.065282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] PATH_INFO: `/v3/users/3ce733eb44f84ef4b3611cc0cc971ac0` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.069160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce733eb44f84ef4b3611cc0cc971ac0)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.070738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.071519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.073130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:49.096910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe527ea-b25d-48c7-aad7-677bc192224d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.127850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.128761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.129047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.129327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] PATH_INFO: `/v3/projects/8b91f0000d494b9fbd69a8b990ba4438` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.132536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b91f0000d494b9fbd69a8b990ba4438)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.134512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.204887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b91f0000d494b9fbd69a8b990ba4438', 'request_id': 'req-de55bf35-d22c-4d3b-a0a6-560219bd9940'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.207275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce733eb44f84ef4b3611cc0cc971ac0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.215192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b91f0000d494b9fbd69a8b990ba4438', 'request_id': 'req-de55bf35-d22c-4d3b-a0a6-560219bd9940'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.219011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:49.230095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b91f0000d494b9fbd69a8b990ba4438', 'request_id': 'req-de55bf35-d22c-4d3b-a0a6-560219bd9940'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.230891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce733eb44f84ef4b3611cc0cc971ac0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.231636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce733eb44f84ef4b3611cc0cc971ac0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.240855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce733eb44f84ef4b3611cc0cc971ac0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.241844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ccca921-4412-4080-a75b-d4a143fe9e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce733eb44f84ef4b3611cc0cc971ac0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.249007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] The token cache is being invalidate because project 8b91f0000d494b9fbd69a8b990ba4438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:49.249357 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.250054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-de55bf35-d22c-4d3b-a0a6-560219bd9940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:49.251951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1096/2238] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:49 2022] DELETE /identity/v3/projects/8b91f0000d494b9fbd69a8b990ba4438 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:49.258000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478a06-ac75-49cd-90c7-539f31bb1798 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.258340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478a06-ac75-49cd-90c7-539f31bb1798 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.258654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478a06-ac75-49cd-90c7-539f31bb1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.261871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1143/2239] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:48 2022] DELETE /identity/v3/users/3ce733eb44f84ef4b3611cc0cc971ac0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:49.265932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.266702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.267121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.289069 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-66478a06-ac75-49cd-90c7-539f31bb1798 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:49.290550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-66478a06-ac75-49cd-90c7-539f31bb1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:49.305375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:49.306778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:49.390752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1097/2240] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:49.394448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:49.399396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.399753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.400091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.422790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:49.423921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1144/2241] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:49.425432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:49.436738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1098/2242] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:49.441214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.441702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.444707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:49.452527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215417c-2780-487d-849e-9cde90c49a8a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.459678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.461020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.461530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.462018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.462877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:49.463406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.465829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.482699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1099/2243] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:49.489688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.501131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5cf3-d6cb-489d-99dc-e614b2ee7423 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.507761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.508372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.508688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.508966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.509610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.511670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.539593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875475f-8f27-43a7-b330-759309a9e04c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.544910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.545534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.546267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.546610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.560896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.562335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1100/2244] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:49.563488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.567442 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.578555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1145/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:49.683888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724fd0-1764-4b38-a5f9-8998a7a53ae9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.694537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.695932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.696607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.696919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.700592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.701612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.733574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1101/2246] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:49.736511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.761623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ef72-0d95-4452-bb3a-af4cb739687d service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.776934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.777647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.778109 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.778328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.778984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.786863 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.824965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1146/2247] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:49.828559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.845430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea452-c176-4b1c-be25-4367933d9562 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.854110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.854998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.855409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.856237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.857108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.859085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d538-860c-473b-9e77-9f06fe659ec1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.872253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1102/2248] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:49.877262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:49.894465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752caa84-ff27-4ffe-884b-f66b69d88690 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:49.900307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:49.901535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.902012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.902478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] PATH_INFO: `/v3/projects/60db43e4c1fd46cd8e0ce26848c4eca9/users/24bfb3ce64db49298a014136e94cb56a/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:49.923734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60db43e4c1fd46cd8e0ce26848c4eca9, user_id=24bfb3ce64db49298a014136e94cb56a, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:49.927399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:49.976169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1147/2249] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:49 2022] PUT /identity/v3/projects/60db43e4c1fd46cd8e0ce26848c4eca9/users/24bfb3ce64db49298a014136e94cb56a/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:49.994025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:49.996253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:49.998968 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.021676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.024066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:50.032004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] MFA Rules not processed for user `24bfb3ce64db49298a014136e94cb56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:50.034100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:50.045262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:50.107930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31fe92-6601-4d76-b10e-48ace4316984 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.117668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.118079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.118371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.118796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] PATH_INFO: `/v3/projects/6ebe20f6758248b48de61f563f6be48c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.119981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebe20f6758248b48de61f563f6be48c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.120119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1103/2250] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:50.122120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.124132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.140736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328113b-474e-4aa0-bcd1-6f0d543375f5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.146548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.147240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.147595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.148427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.148722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.150837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.188129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebe20f6758248b48de61f563f6be48c', 'request_id': 'req-6354a639-c4c1-4da8-995e-9a2f5119e421'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:50.191270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:50.193220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1104/2251] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:50 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:50.197672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.210093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebe20f6758248b48de61f563f6be48c', 'request_id': 'req-6354a639-c4c1-4da8-995e-9a2f5119e421'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:50.219904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebe20f6758248b48de61f563f6be48c', 'request_id': 'req-6354a639-c4c1-4da8-995e-9a2f5119e421'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:50.236605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] The token cache is being invalidate because project 6ebe20f6758248b48de61f563f6be48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:50.237548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:50.238391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:50.240389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1148/2252] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:50 2022] DELETE /identity/v3/projects/6ebe20f6758248b48de61f563f6be48c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:30:50.295400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c416-1bc0-4019-8f14-5c0ee0fae250 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.302318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.303228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.303658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.305538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.305538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.309871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.355300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1105/2253] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:50 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:50.359603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.365814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:50.470276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a639-c4c1-4da8-995e-9a2f5119e421 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.475383 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.476033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.476306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.476720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.477365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.479211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.490207 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1149/2254] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:50.494620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.506340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6cd-16cb-4447-b350-fd9c24e85eff admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.511272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.511885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.512200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.512625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.513284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.514912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f387f1-2b64-4ab0-aaa3-3a2243871861 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.525431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1106/2255] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:50.529752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.539713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b41d8-1bd8-4de7-86f7-58258ef7a222 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.544350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.545038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.545322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.545600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] PATH_INFO: `/v3/projects/57cb50adaffc4721bf3dec15c641eeb3/users/83189094cd72475097323e61f4902ee5/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.561105 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cb50adaffc4721bf3dec15c641eeb3, user_id=83189094cd72475097323e61f4902ee5, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.563774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.577694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1150/2256] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:50 2022] PUT /identity/v3/projects/57cb50adaffc4721bf3dec15c641eeb3/users/83189094cd72475097323e61f4902ee5/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:50.587898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.588323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.588796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.617727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] MFA Rules not processed for user `83189094cd72475097323e61f4902ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:50.619045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:50.703014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:50.709738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1107/2257] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:50.713845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.786765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53ffec-334b-4b27-ba16-cd1760497a85 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.791687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.792301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.792643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.792920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.793802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.795443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.838252 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1151/2258] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:50 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:50.839579 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.852436 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e5463-c9fe-425a-818c-9f593791670b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.919088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86cf51-a197-4718-a177-298608586594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.919766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86cf51-a197-4718-a177-298608586594 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.920044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86cf51-a197-4718-a177-298608586594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.920372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86cf51-a197-4718-a177-298608586594 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.921080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86cf51-a197-4718-a177-298608586594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.923073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86cf51-a197-4718-a177-298608586594 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.951257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1108/2259] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:50 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:30:50.952423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.963171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4122e4-d3cb-427b-a1ce-63406a34e305 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:50.968382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:50.969126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:50.969430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:50.969708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:50.970368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:50.972530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:50.983962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1152/2260] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:50.988356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86cf51-a197-4718-a177-298608586594 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:50.998504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86cf51-a197-4718-a177-298608586594 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:51.003643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:51.004296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.004605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.005255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] PATH_INFO: `/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0/users/5f8a6c4b608e4ba2a39497196a8af924/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.020809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb24b8b8ebee48b29062bd7f13a334a0, user_id=5f8a6c4b608e4ba2a39497196a8af924, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:51.023613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:51.038737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1109/2261] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:50 2022] PUT /identity/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0/users/5f8a6c4b608e4ba2a39497196a8af924/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:51.042922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:51.055130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387796-aa35-4b45-a0ab-62cb878d21a7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:51.080625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:51.117893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:51.118503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.118786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.119056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.119698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:51.121377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367babb-9717-41b3-82d4-becec18f7933 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:51.134944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1153/2262] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:51.136119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:51.150906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa106-941f-4a5e-b0ec-8a50441ffc3a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:51.155653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:51.156309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.156610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.156886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] PATH_INFO: `/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0/users/5f8a6c4b608e4ba2a39497196a8af924/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.158817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb24b8b8ebee48b29062bd7f13a334a0, user_id=5f8a6c4b608e4ba2a39497196a8af924, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:51.161618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:51.172360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1110/2263] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:51 2022] PUT /identity/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0/users/5f8a6c4b608e4ba2a39497196a8af924/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:51.183785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.184099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.184344 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.212506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] MFA Rules not processed for user `5f8a6c4b608e4ba2a39497196a8af924`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:51.213751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:51.293651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1154/2264] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:51.303596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:51.305465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:51.363559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662cb1d-80e0-4e71-9c47-435ba3966af0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:51.367230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:51.367834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.368170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.368506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.378670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:51.380096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:51.389459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1111/2265] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:51.436036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:51.446684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96939-2979-4759-ac82-99fd4326ff2f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:51.464243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:51.464915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:51.465201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:51.465475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:51.467258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:51.529927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:51.531346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67b57-9956-44fb-b31e-84efd5dfa622 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:51.540649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1155/2266] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:54.491782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:54.554241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:54.566270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe022-cd6d-40bb-88ab-87181cbe8ffe service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:54.570831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:54.571470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:54.571754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:54.572033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] PATH_INFO: `/v3/users/24bfb3ce64db49298a014136e94cb56a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:54.573179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bfb3ce64db49298a014136e94cb56a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:54.575098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:54.656239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bfb3ce64db49298a014136e94cb56a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:54.657071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bfb3ce64db49298a014136e94cb56a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:54.657853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bfb3ce64db49298a014136e94cb56a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:54.666341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bfb3ce64db49298a014136e94cb56a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:54.682606 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bfb3ce64db49298a014136e94cb56a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:54.700808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1112/2267] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:54 2022] DELETE /identity/v3/users/24bfb3ce64db49298a014136e94cb56a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:54.705561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:54.706053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:54.706889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:54.726360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:54.727586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:54.802773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:54.822900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1156/2268] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:54.835296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:54.837193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:54.913904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fe168-c42c-4646-a66b-666e328bddc0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:54.917725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:54.918407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:54.918753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:54.919115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:54.932544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:54.933996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:54.948313 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1113/2269] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:30:55.263657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:55.265136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:55.278258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca49b5-6831-45fd-b63f-64ffa71e13e7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:55.285521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:55.292030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:55.292376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:55.292691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] PATH_INFO: `/v3/projects/60db43e4c1fd46cd8e0ce26848c4eca9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:55.296205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60db43e4c1fd46cd8e0ce26848c4eca9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:55.299175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:55.359451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60db43e4c1fd46cd8e0ce26848c4eca9', 'request_id': 'req-124a804d-6ee0-4351-96ce-b499146b5cc4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.365094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60db43e4c1fd46cd8e0ce26848c4eca9', 'request_id': 'req-124a804d-6ee0-4351-96ce-b499146b5cc4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.372548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60db43e4c1fd46cd8e0ce26848c4eca9', 'request_id': 'req-124a804d-6ee0-4351-96ce-b499146b5cc4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.384165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] The token cache is being invalidate because project 60db43e4c1fd46cd8e0ce26848c4eca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:55.384453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.385169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.386640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1157/2270] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:55 2022] DELETE /identity/v3/projects/60db43e4c1fd46cd8e0ce26848c4eca9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:55.390782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:55.401011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbb79-5a9b-4958-a130-5413e4173d0e service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:55.456770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:55.457435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:55.457717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:55.458043 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] PATH_INFO: `/v3/users/83189094cd72475097323e61f4902ee5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:55.459224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83189094cd72475097323e61f4902ee5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:55.461301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:55.478539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:55.508206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83189094cd72475097323e61f4902ee5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.508868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83189094cd72475097323e61f4902ee5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.509536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83189094cd72475097323e61f4902ee5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.516710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83189094cd72475097323e61f4902ee5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.529023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83189094cd72475097323e61f4902ee5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:55.542714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1114/2271] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:55 2022] DELETE /identity/v3/users/83189094cd72475097323e61f4902ee5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:55.919875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:55.922310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:55.966088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a804d-6ee0-4351-96ce-b499146b5cc4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:56.034994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:56.034994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.035606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.035985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] PATH_INFO: `/v3/projects/57cb50adaffc4721bf3dec15c641eeb3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.037525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cb50adaffc4721bf3dec15c641eeb3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:56.039267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:56.098175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cb50adaffc4721bf3dec15c641eeb3', 'request_id': 'req-12e59804-d51a-4a01-b48c-71570287cee9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.105106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cb50adaffc4721bf3dec15c641eeb3', 'request_id': 'req-12e59804-d51a-4a01-b48c-71570287cee9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.113921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cb50adaffc4721bf3dec15c641eeb3', 'request_id': 'req-12e59804-d51a-4a01-b48c-71570287cee9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.136831 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:56.138388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] The token cache is being invalidate because project 57cb50adaffc4721bf3dec15c641eeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:56.138763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.139469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.141489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1158/2272] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:55 2022] DELETE /identity/v3/projects/57cb50adaffc4721bf3dec15c641eeb3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:56.146989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:56.148707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:56.162006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9bda-fc2a-4f5e-b2bf-87eede620400 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:56.244051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:56.245005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.245434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.245850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] PATH_INFO: `/v3/users/5f8a6c4b608e4ba2a39497196a8af924` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.247232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8a6c4b608e4ba2a39497196a8af924)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:56.249261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:56.316829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8a6c4b608e4ba2a39497196a8af924'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.317910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8a6c4b608e4ba2a39497196a8af924'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.318647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8a6c4b608e4ba2a39497196a8af924'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.327217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8a6c4b608e4ba2a39497196a8af924'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.343427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e44d755f-b883-4970-91e9-1957c5c4d5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8a6c4b608e4ba2a39497196a8af924'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.358208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1115/2273] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:30:56 2022] DELETE /identity/v3/users/5f8a6c4b608e4ba2a39497196a8af924 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:56.637134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:56.638983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:56.657635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e59804-d51a-4a01-b48c-71570287cee9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:56.719115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:56.719657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.719936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.720208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] PATH_INFO: `/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.721335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb24b8b8ebee48b29062bd7f13a334a0)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:56.723253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:56.779149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb24b8b8ebee48b29062bd7f13a334a0', 'request_id': 'req-530b173e-1a50-4b3e-88c9-df69bf772d17'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.785745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb24b8b8ebee48b29062bd7f13a334a0', 'request_id': 'req-530b173e-1a50-4b3e-88c9-df69bf772d17'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.794565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb24b8b8ebee48b29062bd7f13a334a0', 'request_id': 'req-530b173e-1a50-4b3e-88c9-df69bf772d17'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.824929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] The token cache is being invalidate because project bb24b8b8ebee48b29062bd7f13a334a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:30:56.825217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.825873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-530b173e-1a50-4b3e-88c9-df69bf772d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:30:56.827356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1159/2274] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:30:56 2022] DELETE /identity/v3/projects/bb24b8b8ebee48b29062bd7f13a334a0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:56.833548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.834002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.834090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.857975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:56.859500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:56.869962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:56.928508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1116/2275] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:56.937274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.937751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.937865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.960848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:56.962056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:56.969889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1160/2276] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:30:56.974129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:56.983865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e93df-fc61-4700-8690-8533f45c0cec None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:56.988398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:56.989090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:56.989368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:56.990725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:56.990725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:30:56.990725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:56.992149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.004159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1117/2277] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:30:57.008687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.019802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5161e6-477f-47ca-b290-1b23fcb1dfb7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.024380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.025011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.025461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.025727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.026361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.028227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.057228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1161/2278] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:30:57 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:57.061454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.072106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad359f1-4a78-488e-ab3b-1402de78c30b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.139654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.140544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.140863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.141171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.141817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.144268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.172622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1118/2279] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:30:57 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:30:57.173761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.185797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82a443-1bc6-4719-bfa9-2bbccb70c491 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.191776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.192356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.192677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.192968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.193610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.205565 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.220607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1162/2280] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:30:57.224806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.235628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41534909-11a0-4d37-a8eb-f23557bdd40c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.241417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.242060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.242343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.242616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.243294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.244926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af8e3-fd07-48b1-9bda-f31218688f5c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.261224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1119/2281] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:30:57.265213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.275926 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50a7fd-ad24-4a3b-aece-506d4096bc70 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.280725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.281463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.281810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.282150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] PATH_INFO: `/v3/projects/2a1684735b14456aa14d6cec411cb2c1/users/a08027e646dd4a5db08fc636164f76d9/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.305564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1684735b14456aa14d6cec411cb2c1, user_id=a08027e646dd4a5db08fc636164f76d9, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.308103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.335648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1163/2282] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:30:57 2022] PUT /identity/v3/projects/2a1684735b14456aa14d6cec411cb2c1/users/a08027e646dd4a5db08fc636164f76d9/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:30:57.337295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.337587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.337865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.367905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] MFA Rules not processed for user `a08027e646dd4a5db08fc636164f76d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:30:57.369305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:57.453035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1120/2283] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:30:57.470244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:30:57.474412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:30:57.507913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:57.544925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1650a05-834b-4d1c-b978-2cec5f8f85ce admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:30:57.550356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:30:57.551116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:30:57.551426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:30:57.551728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:30:57.561692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:30:57.563114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ed40a-fa52-4444-a6ba-de0fa936bf62 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:30:57.573623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1164/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:30:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:00.101895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:00.112174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83cbfe-6cd5-4a27-956d-4cf47728e3ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:00.115983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:00.116729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:00.117076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:00.117417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:00.119208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:00.126173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:00.215379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:00.216982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:00.227670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1121/2285] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:31:01.288893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4cc0-7dc1-4559-a208-4b2abb05771a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:01.289321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4cc0-7dc1-4559-a208-4b2abb05771a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:01.289486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4cc0-7dc1-4559-a208-4b2abb05771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:01.310791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b66d4cc0-7dc1-4559-a208-4b2abb05771a None None] MFA Rules not processed for user `f856533ec21848db82c0fef655013f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:01.311977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b66d4cc0-7dc1-4559-a208-4b2abb05771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:01.366918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1165/2286] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:08.099126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:08.101015 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:08.173271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfb920-a96e-4251-a071-59490404b386 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:08.177885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:08.178513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:08.178792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:08.179071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] PATH_INFO: `/v3/users/96bf5095b2004bccb0005257f1cecebf` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:08.180289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bf5095b2004bccb0005257f1cecebf)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:08.182516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:08.241661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bf5095b2004bccb0005257f1cecebf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.242764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bf5095b2004bccb0005257f1cecebf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.243403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bf5095b2004bccb0005257f1cecebf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.252965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bf5095b2004bccb0005257f1cecebf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.271556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bf5095b2004bccb0005257f1cecebf'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.295228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1122/2287] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:08 2022] DELETE /identity/v3/users/96bf5095b2004bccb0005257f1cecebf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:08.297750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:08.298246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:08.298364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:08.323096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:08.324679 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:08.404386 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1166/2288] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:08.414248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:08.415662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:08.443395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:08.477211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd6f2-be8d-44d2-8460-ee557daf280d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:08.481079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:08.481772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:08.481990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:08.482260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:08.491930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:08.493692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664f42f-241a-4586-9c9a-064710889e87 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:08.504526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1123/2289] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:08.804400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:08.806067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:08.824065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d8e6-efaa-436a-9ecc-25773259d134 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:08.828496 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:08.829158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:08.829648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:08.829998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] PATH_INFO: `/v3/projects/932715d4f93846efbac2f2261686a128` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:08.831291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=932715d4f93846efbac2f2261686a128)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:08.833212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:08.899122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932715d4f93846efbac2f2261686a128', 'request_id': 'req-ffde6a9b-5750-46ac-960c-0c4db4279aef'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.906134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932715d4f93846efbac2f2261686a128', 'request_id': 'req-ffde6a9b-5750-46ac-960c-0c4db4279aef'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.914777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932715d4f93846efbac2f2261686a128', 'request_id': 'req-ffde6a9b-5750-46ac-960c-0c4db4279aef'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.926805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:08.936589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] The token cache is being invalidate because project 932715d4f93846efbac2f2261686a128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:08.936905 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.937641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffde6a9b-5750-46ac-960c-0c4db4279aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:08.942304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1167/2290] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:08 2022] DELETE /identity/v3/projects/932715d4f93846efbac2f2261686a128 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:08.947997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:08.948337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:08.948645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:08.975625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:08.976812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:09.064597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1124/2291] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:09.070228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.070609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.070964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.092389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:09.093680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:09.107183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1168/2292] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:09.111547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.122318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea6f1-ee84-4bcd-9944-5a157d9e173d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.126953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.127620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.127905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.128181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.128920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:09.129222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.131151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.145173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1125/2293] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:31:09.149970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.162541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56b4bd-944b-451d-ace5-951186c60987 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.167826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.168437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.168851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.169068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.169715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.171542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.211928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1169/2294] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:09 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:09.213804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.226977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a678-bec3-4a07-a323-df38739c8f7e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.313483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.313892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.314343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.314572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.315788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.317750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.353040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1126/2295] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:09 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:09.364428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.369725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a86c3-0105-409e-9143-1cd7aae6cce2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.374839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.375593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.375965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.376329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.377166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.379044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.389934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1170/2296] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:31:09.394531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.404366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca6fd-3ef0-4b13-a8c4-0da750bc71c5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.409895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.410514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.410793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.411066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.411702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.413314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cd5d7-03f3-4a3d-ae04-94d611f4e512 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.424381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1127/2297] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:09.428697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.438948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871ead9-5ecd-43c0-a194-7bacd63a83b8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.444176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.445018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.445430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.445775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] PATH_INFO: `/v3/projects/4bc18aba1e6847b39c839a8318b88222/users/ebc32a9d4d704781872d0d64466b18f6/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.462952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc18aba1e6847b39c839a8318b88222, user_id=ebc32a9d4d704781872d0d64466b18f6, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.465789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.481284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1171/2298] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:09 2022] PUT /identity/v3/projects/4bc18aba1e6847b39c839a8318b88222/users/ebc32a9d4d704781872d0d64466b18f6/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:09.492513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.492831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.493105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.523826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] MFA Rules not processed for user `ebc32a9d4d704781872d0d64466b18f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:09.525149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:09.546420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:09.599170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1128/2299] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:09.610940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.613403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:09.671035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcfadf-b4d0-4ec3-89f4-6b99cec62174 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.675598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.676201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.676513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.676814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.684916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.686335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b172a0-3a36-4e0c-9e39-a8bfb0777d58 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.695172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1172/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:09.719207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.782031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdd5c6-6af1-449e-acbe-104fb05354f3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:09.787091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:09.787750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.788032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.788307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] PATH_INFO: `/v3/users/ebc32a9d4d704781872d0d64466b18f6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.789458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc32a9d4d704781872d0d64466b18f6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:09.791413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:09.838638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc32a9d4d704781872d0d64466b18f6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:09.839552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc32a9d4d704781872d0d64466b18f6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:09.840171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc32a9d4d704781872d0d64466b18f6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:09.847837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc32a9d4d704781872d0d64466b18f6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:09.860624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc32a9d4d704781872d0d64466b18f6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:09.874774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1129/2301] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:09 2022] DELETE /identity/v3/users/ebc32a9d4d704781872d0d64466b18f6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:09.879304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:09.879592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:09.879874 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:09.898528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:09.899718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:09.959213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1173/2302] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:09.968931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:09.970384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.013887 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:10.031409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b991a00-4bd5-48f0-9eff-f51d16d4c518 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:10.035583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:10.036184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.036462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.036762 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.046216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:10.047619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:10.057045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1130/2303] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:10.451398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:10.454526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.474750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc18889-c630-4e51-ae17-f7ea7b5a8774 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:10.484133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:10.484861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.496692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.497063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] PATH_INFO: `/v3/projects/4bc18aba1e6847b39c839a8318b88222` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.499379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc18aba1e6847b39c839a8318b88222)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:10.501902 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:10.567455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:10.584696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc18aba1e6847b39c839a8318b88222', 'request_id': 'req-5b23541c-547b-4da6-ad87-a7cd50117783'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.592468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc18aba1e6847b39c839a8318b88222', 'request_id': 'req-5b23541c-547b-4da6-ad87-a7cd50117783'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.605330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc18aba1e6847b39c839a8318b88222', 'request_id': 'req-5b23541c-547b-4da6-ad87-a7cd50117783'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.616602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:10.618899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.620053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] The token cache is being invalidate because project 4bc18aba1e6847b39c839a8318b88222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:10.620556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.621474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b23541c-547b-4da6-ad87-a7cd50117783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.623577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1174/2304] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:10 2022] DELETE /identity/v3/projects/4bc18aba1e6847b39c839a8318b88222 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:31:10.629182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b35-a992-4438-87b9-fcdd63dfcd5b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.629687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b35-a992-4438-87b9-fcdd63dfcd5b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.630253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6b35-a992-4438-87b9-fcdd63dfcd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.644795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d357c-b718-4d1f-b509-b7d8d4c89ac3 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:10.682667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0f8e6b35-a992-4438-87b9-fcdd63dfcd5b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:10.684975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f8e6b35-a992-4438-87b9-fcdd63dfcd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.764518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:10.765448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.765872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.766365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] PATH_INFO: `/v3/users/a08027e646dd4a5db08fc636164f76d9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.767780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08027e646dd4a5db08fc636164f76d9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:10.771745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:10.787474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1175/2305] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:10.796802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.797540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.798064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.827646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:10.835071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.838856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08027e646dd4a5db08fc636164f76d9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.840112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08027e646dd4a5db08fc636164f76d9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.841002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08027e646dd4a5db08fc636164f76d9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.849468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1176/2306] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:10.851211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08027e646dd4a5db08fc636164f76d9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.854656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:10.870218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d69a0a88-a9c8-4ded-b670-88f08419c2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08027e646dd4a5db08fc636164f76d9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:10.870432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41849723-b44f-46be-bd67-a3d4fac41be9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:10.878671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:10.879478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.879911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.880194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.880885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:10.881192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:10.882793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:10.888619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1131/2307] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:10 2022] DELETE /identity/v3/users/a08027e646dd4a5db08fc636164f76d9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:31:10.894407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:10.895282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:10.895569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:10.902213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1177/2308] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:31:10.906822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:10.923651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:10.925729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:10.929135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3ca-a80b-464d-afae-f760916f6e34 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:10.999714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.000415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.000756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.000980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.001938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.004037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.020381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1132/2309] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:11.030592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.032070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:11.038347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:11.047867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1178/2310] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:10 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:11.051901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.082327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:11.100235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08a4ca-9154-4a9e-8823-5a6bb1dcf821 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.118940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f7321-9880-44a2-b4ca-bcf84fa6767d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.123749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.124365 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.124677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.124987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.125615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.128040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.150235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1179/2311] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:11 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:11.151338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.151957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.152240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.152535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.154240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.163976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.164859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72d7f-da62-49db-8909-1a550b09245d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.165517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.170171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.171421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.171711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.172298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.173002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.175359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.176842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1133/2312] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:11.186730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1180/2313] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:31:11.191123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.201276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25417e4d-ced7-41d3-8ceb-cf5bc41106af service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.207052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.207670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.207952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.208229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.208911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.210503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d523b-436c-4802-a066-f3249433bc65 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.228893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1134/2314] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:11.229640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.243693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4087-addd-4a6f-a609-c5e6e1da689c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.249529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.250204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.250486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.250765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] PATH_INFO: `/v3/projects/716abeafc8fa49ae95ad7addab8087f3/users/2ca33771bd0a4ceaabe014ffef14e87e/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.267686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=716abeafc8fa49ae95ad7addab8087f3, user_id=2ca33771bd0a4ceaabe014ffef14e87e, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.270433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.286363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1181/2315] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:11 2022] PUT /identity/v3/projects/716abeafc8fa49ae95ad7addab8087f3/users/2ca33771bd0a4ceaabe014ffef14e87e/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:31:11.297504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.297797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.298139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.329136 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] MFA Rules not processed for user `2ca33771bd0a4ceaabe014ffef14e87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:11.329507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:11.401446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1135/2316] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:11.413223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.414982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:11.477162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204fe0-2e49-4405-90d5-4483ff336c8a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.484380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.485116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.485477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.485826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.498504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.499148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81801f-c6f6-49a7-849e-732d3ec3c886 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.512923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1182/2317] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:11.554458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:11.569286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:11.649607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:11.681083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d6689-aecc-4eb0-9e42-6e3b7a776312 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:11.690892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:11.692635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.693135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.693599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] PATH_INFO: `/v3/projects/2a1684735b14456aa14d6cec411cb2c1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.697050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1684735b14456aa14d6cec411cb2c1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:11.700110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:11.784774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1684735b14456aa14d6cec411cb2c1', 'request_id': 'req-5604d3ab-aa08-435d-8153-2597a76b4387'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:11.793395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1684735b14456aa14d6cec411cb2c1', 'request_id': 'req-5604d3ab-aa08-435d-8153-2597a76b4387'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:11.803453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1684735b14456aa14d6cec411cb2c1', 'request_id': 'req-5604d3ab-aa08-435d-8153-2597a76b4387'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:11.827636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] The token cache is being invalidate because project 2a1684735b14456aa14d6cec411cb2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:11.828445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:11.829331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5604d3ab-aa08-435d-8153-2597a76b4387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:11.834764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1136/2318] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:11 2022] DELETE /identity/v3/projects/2a1684735b14456aa14d6cec411cb2c1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:11.840482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:11.840853 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:11.841144 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:11.862992 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:11.864221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:11.956598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1183/2319] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:12.025539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.026557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.026841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.052537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:12.053830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:12.061951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1137/2320] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:12.066755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.091788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0423db9-bd89-4b90-8816-67a1487ad13a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.096864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.097583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.097923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.098265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.099619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:12.100047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.101755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.114268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1184/2321] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:31:12.118687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.129112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bfbbc-8cc1-4710-9018-8587c0a1bb8a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.138812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.139684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.139977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.140268 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.140973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.142882 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.170406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1138/2322] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:12 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:12.175183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.189512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57be0af-23f3-453d-b85f-19387a84d381 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.197988 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:12.253458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.254086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.254355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.254629 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.255262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.257183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.283277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1185/2323] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:12 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:12.288170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.298786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8832a-003e-4f01-88fb-0a182ceaec2a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.303392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.304055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.304277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.304553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.305253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.306857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.318295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1139/2324] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:12.322544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.334040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe26fa-790c-4ae9-8e95-cde43b5ba5c9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.339272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.339878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.340176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.340477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.341175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.342760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50af25-b0d7-40ea-8072-cf6f98d8adf9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.354726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1186/2325] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:12.359191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.370471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4c5f0-3e26-4ea2-a8e6-3d8820dc4e90 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.375510 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.376224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.376499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.376804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] PATH_INFO: `/v3/projects/d4b2f4db293f4a25bb5edd562bdbdff1/users/fa89a469af8a4bed82778f6c48f1d604/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.392125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b2f4db293f4a25bb5edd562bdbdff1, user_id=fa89a469af8a4bed82778f6c48f1d604, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.395474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.411955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1140/2326] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:12 2022] PUT /identity/v3/projects/d4b2f4db293f4a25bb5edd562bdbdff1/users/fa89a469af8a4bed82778f6c48f1d604/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:12.417159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1dc9-b524-465c-85dd-a113b69c08cc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.417451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1dc9-b524-465c-85dd-a113b69c08cc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.417821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1dc9-b524-465c-85dd-a113b69c08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.441834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-02be1dc9-b524-465c-85dd-a113b69c08cc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:12.443110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02be1dc9-b524-465c-85dd-a113b69c08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:12.506681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1187/2327] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:12.516152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:12.517902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:12.575519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020c38-f4ee-4cae-84df-ba37c429e070 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:12.580230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:12.580876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:12.581151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:12.581422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:12.593819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:12.595724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f030-7577-4caa-8e57-4f5dd1b801b9 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:12.607401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1141/2328] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:13.058894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:13.059097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:13.059382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:13.089251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] MFA Rules not processed for user `2ca33771bd0a4ceaabe014ffef14e87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:13.090756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:13.250366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1188/2329] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:19.542016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:19.543194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:19.543501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:19.569396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:19.590362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] MFA Rules not processed for user `fa89a469af8a4bed82778f6c48f1d604`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:19.591410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:19.760133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1142/2330] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:19.764660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:19.784923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8ee3-17dd-4a0e-9e45-4e4bfce556e6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:19.791788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:19.792684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:19.793465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:19.793932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:19.795009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:19.797364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:19.859671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1189/2331] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:19 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:19.862841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:19.879063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47e391-aef9-45ca-8eba-7e0cb089f086 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.038502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.039920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.041922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.042468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.043193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:20.043846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.049590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.054350 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.068162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f047b1c-fbd9-4e66-bcf0-5bd958455fd4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.085909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.086588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.091978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.094662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] PATH_INFO: `/v3/users/8b3b286a43e147bab49bcb660ea38694` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.100068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3b286a43e147bab49bcb660ea38694)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.118341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.132221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:20.172277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1143/2332] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:19 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:20.204317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.248529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ca454-ce44-4293-b5a2-62a277c7dfee admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.260104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3b286a43e147bab49bcb660ea38694'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:20.268960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.269945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.270374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.270820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.273281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.276462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.295422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3b286a43e147bab49bcb660ea38694'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:20.296945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3b286a43e147bab49bcb660ea38694'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:20.315284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3b286a43e147bab49bcb660ea38694'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:20.316379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93c7797e-46b0-4b28-9661-d51a1eb8b90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3b286a43e147bab49bcb660ea38694'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:20.320145 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1144/2333] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:20.327116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.338159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:20.357452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f10dc-08ad-4279-b94b-bf012f49551c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.371656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1190/2334] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:20 2022] DELETE /identity/v3/users/8b3b286a43e147bab49bcb660ea38694 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:31:20.388836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.389302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.389597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.389884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] PATH_INFO: `/v3/projects/fd910caf80f04c08956822f31bfd967e/users/770bb3ff0cb94295b9ee3af2552de05f/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.399429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.404607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.406829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.423889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd910caf80f04c08956822f31bfd967e, user_id=770bb3ff0cb94295b9ee3af2552de05f, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.429452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.454868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1145/2335] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:20 2022] PUT /identity/v3/projects/fd910caf80f04c08956822f31bfd967e/users/770bb3ff0cb94295b9ee3af2552de05f/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:20.461235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.473688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:20.477093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:20.552772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:20.568700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f108-a94b-45b2-93e8-1784557106ce admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.574422 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.575059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.575345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.575621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.576287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.577995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.599068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1146/2336] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:31:20.600017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.620504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa3-4772-49fd-bfd6-4dd2df1f9793 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.634122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.634816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.635101 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.638722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] PATH_INFO: `/v3/projects/fd910caf80f04c08956822f31bfd967e/users/770bb3ff0cb94295b9ee3af2552de05f/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:20.642528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd910caf80f04c08956822f31bfd967e, user_id=770bb3ff0cb94295b9ee3af2552de05f, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:20.647885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:20.656940 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1191/2337] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:20.671825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1147/2338] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:20 2022] PUT /identity/v3/projects/fd910caf80f04c08956822f31bfd967e/users/770bb3ff0cb94295b9ee3af2552de05f/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:20.676933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:20.678512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:20.791355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae60668-adf1-4d78-9710-1d76ab72ba6c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:20.867746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:20.881363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:20.881997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:20.882278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:20.882548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:21.038795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:21.042292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae19763-b16e-4da6-88b8-7607baf9824c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:21.082858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1192/2339] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:22.322056 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:22.325476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:22.351048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd43c0e-3d4c-4451-b6fa-51d8b679fd5b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:22.359525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:22.360471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:22.360795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:22.361075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] PATH_INFO: `/v3/projects/9a474700b12e4f38a3b25464aab5e331` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:22.363071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a474700b12e4f38a3b25464aab5e331)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:22.365532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:22.503050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a474700b12e4f38a3b25464aab5e331', 'request_id': 'req-34082db2-c049-4750-84b7-311a2d565f5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:22.547418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a474700b12e4f38a3b25464aab5e331', 'request_id': 'req-34082db2-c049-4750-84b7-311a2d565f5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:22.569326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a474700b12e4f38a3b25464aab5e331', 'request_id': 'req-34082db2-c049-4750-84b7-311a2d565f5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:22.599942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] The token cache is being invalidate because project 9a474700b12e4f38a3b25464aab5e331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:22.600532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:22.603599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-34082db2-c049-4750-84b7-311a2d565f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:22.609062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1148/2340] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:22 2022] DELETE /identity/v3/projects/9a474700b12e4f38a3b25464aab5e331 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:22.632895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d45-8f0c-4651-a0bb-101d899277c3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:22.633437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d45-8f0c-4651-a0bb-101d899277c3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:22.633437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08d45-8f0c-4651-a0bb-101d899277c3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:22.648974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1193/2341] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:31:22 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:31:22.710720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace79d9-e8f5-4935-8747-58d57bbe9044 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:22.711120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace79d9-e8f5-4935-8747-58d57bbe9044 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:22.711262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace79d9-e8f5-4935-8747-58d57bbe9044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:22.754826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6ace79d9-e8f5-4935-8747-58d57bbe9044 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:22.756190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ace79d9-e8f5-4935-8747-58d57bbe9044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:22.990827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1149/2342] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:31:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:23.007091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46f10-4242-41ef-b22f-d27ff9419df4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:23.007374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46f10-4242-41ef-b22f-d27ff9419df4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:23.007656 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46f10-4242-41ef-b22f-d27ff9419df4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:23.009560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1194/2343] 10.222.0.30 () {54 vars in 961 bytes} [Fri Sep 9 06:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:31:23.052521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b98b2-29b1-4c1a-a933-da559bf2a1c4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:23.053764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b98b2-29b1-4c1a-a933-da559bf2a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:23.054207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b98b2-29b1-4c1a-a933-da559bf2a1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:23.148915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-674b98b2-29b1-4c1a-a933-da559bf2a1c4 None None] MFA Rules not processed for user `7d2275234f9942e8bcf532855433d5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:23.150315 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-674b98b2-29b1-4c1a-a933-da559bf2a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:23.183339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1150/2344] 10.222.0.30 () {58 vars in 1058 bytes} [Fri Sep 9 06:31:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:23.195482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df46f10-4242-41ef-b22f-d27ff9419df4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:23.233596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df46f10-4242-41ef-b22f-d27ff9419df4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:23.248405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:23.251058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:23.251712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:23.252821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:23.270430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:23.274394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:23.319375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1195/2345] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:23.663682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:23.664421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:23.664421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:23.697831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:23.699151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:23.778149 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:23.798060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1151/2346] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:23.869371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:23.871380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:23.998400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537119-1009-46ae-973e-a1ca19cd0a27 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:24.005908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:24.006662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:24.007076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:24.007452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:24.023500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:24.027542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:24.042210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1196/2347] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:31:24.815270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:24.816938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:24.999682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b098e-1573-4e32-a02f-70cb2a9f9cf9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:25.018110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:25.019184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:25.019639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:25.020068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] PATH_INFO: `/v3/users/eb8c48d4d45e43278187293994810b57` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:25.021662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8c48d4d45e43278187293994810b57)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:25.024239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:25.162447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8c48d4d45e43278187293994810b57'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:25.163403 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8c48d4d45e43278187293994810b57'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:25.166465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8c48d4d45e43278187293994810b57'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:25.204207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8c48d4d45e43278187293994810b57'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:25.226602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8c48d4d45e43278187293994810b57'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:25.260870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1152/2348] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:24 2022] DELETE /identity/v3/users/eb8c48d4d45e43278187293994810b57 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:26.367534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:26.390989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08d57-5ccd-4fa7-9c5b-2db3a348ca5e service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:26.570653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:26.571962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:26.572267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:26.572522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] PATH_INFO: `/v3/projects/cb528786d4ee41d990e7964d4f7687c1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:26.576422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb528786d4ee41d990e7964d4f7687c1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:26.578399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:26.612167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:26.689834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb528786d4ee41d990e7964d4f7687c1', 'request_id': 'req-967e3a52-251d-4968-a961-c5301492f59b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:26.703637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb528786d4ee41d990e7964d4f7687c1', 'request_id': 'req-967e3a52-251d-4968-a961-c5301492f59b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:26.720179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb528786d4ee41d990e7964d4f7687c1', 'request_id': 'req-967e3a52-251d-4968-a961-c5301492f59b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:26.746330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] The token cache is being invalidate because project cb528786d4ee41d990e7964d4f7687c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:26.746780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:26.747627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:26.752936 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1197/2349] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:26 2022] DELETE /identity/v3/projects/cb528786d4ee41d990e7964d4f7687c1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:26.756623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:26.759157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:26.787739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1741bd-7251-4c4b-8208-370a01e1e720 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:26.924150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:26.924838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:26.925121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:26.925401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] PATH_INFO: `/v3/users/7059f40b2e274b64984a7db168546393` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:26.932610 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7059f40b2e274b64984a7db168546393)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:26.934733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:26.964990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:27.064251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7059f40b2e274b64984a7db168546393'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:27.065620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7059f40b2e274b64984a7db168546393'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:27.066706 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7059f40b2e274b64984a7db168546393'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:27.077822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7059f40b2e274b64984a7db168546393'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:27.121395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4479bc11-8375-4f07-a39f-12b49a71dadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7059f40b2e274b64984a7db168546393'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:27.144809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1153/2350] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:26 2022] DELETE /identity/v3/users/7059f40b2e274b64984a7db168546393 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:27.627811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:27.630824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:27.667873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e3a52-251d-4968-a961-c5301492f59b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:27.892455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:27.893408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:27.893728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:27.894121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] PATH_INFO: `/v3/projects/5959285bcbcf4204a1a65ba7dea531ee` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:27.896548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5959285bcbcf4204a1a65ba7dea531ee)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:27.901747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:28.031114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5959285bcbcf4204a1a65ba7dea531ee', 'request_id': 'req-daf026f9-6097-4814-81d8-9e2db64ec995'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:28.038241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5959285bcbcf4204a1a65ba7dea531ee', 'request_id': 'req-daf026f9-6097-4814-81d8-9e2db64ec995'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:28.056673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5959285bcbcf4204a1a65ba7dea531ee', 'request_id': 'req-daf026f9-6097-4814-81d8-9e2db64ec995'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:28.087306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] The token cache is being invalidate because project 5959285bcbcf4204a1a65ba7dea531ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:28.087688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:28.089971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-daf026f9-6097-4814-81d8-9e2db64ec995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:28.098539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1198/2351] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:27 2022] DELETE /identity/v3/projects/5959285bcbcf4204a1a65ba7dea531ee => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:28.103502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.104061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.104061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.156160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:28.157454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:28.336353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.336857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1154/2352] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:28.336994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.337309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.388809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:28.390046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:28.412436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1199/2353] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:28.416816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:28.436480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7f72-b0e4-4911-bc4a-0065ccc42f67 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:28.444430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:28.445233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.445448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.445736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.446406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:28.446734 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:28.449097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:28.487906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:28.488877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1155/2354] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:31:28.506082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022071af-2628-411b-ab79-051c08daf5c2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:28.522957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:28.523710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.523887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.524166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.524850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:28.529303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:28.595498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:28.624206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1200/2355] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:28 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:28.625527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:28.644105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394e040-85af-42ec-8522-51d693de63b6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:28.806176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:28.808773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.809307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.810941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.811847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:28.816784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:28.902089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:28.912931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1156/2356] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:28 2022] POST /identity/v3/users => generated 280 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:28.918633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964868-df4e-4d2b-9bf5-0d4e4dacf3b2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:28.939054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:28.941669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:28.941980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:28.942263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:28.943005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:28.949576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:28.990351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1201/2357] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:28.994289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:29.007298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd78cc-c42f-48fc-a3d8-760e7ade1201 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:29.018809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:29.019474 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:29.019774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:29.020044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:29.020729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:29.028175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac6ef-032b-4326-94d8-87aa86839f12 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:29.038847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:29.053767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1157/2358] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:29.058140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:29.069854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc8a1-abb7-46ff-b2d1-9287c109db83 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:29.092747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:29.093733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:29.100364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:29.102669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] PATH_INFO: `/v3/projects/283be17a6e0a4f84b77ebcde18597c96/users/36591d5ee2964d2ab6195ec372000581/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:29.171873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=283be17a6e0a4f84b77ebcde18597c96, user_id=36591d5ee2964d2ab6195ec372000581, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:29.174999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:29.209951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1202/2359] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:29 2022] PUT /identity/v3/projects/283be17a6e0a4f84b77ebcde18597c96/users/36591d5ee2964d2ab6195ec372000581/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:29.221862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:29.222782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:29.223312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:29.306134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] MFA Rules not processed for user `36591d5ee2964d2ab6195ec372000581`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:29.322030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:29.519789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1158/2360] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:29.557717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:29.559531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:29.747100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9141b7-fb0b-4e18-adf9-b5c784c12dbe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:29.758925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:29.760449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:29.762426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:29.763610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:29.789438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:29.794742 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09864d18-05bd-4f39-a6d4-3e0b4a1a8948 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:29.832146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1203/2361] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:29.846333 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:29.975823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd301c2-e385-438a-bfbf-5e007e905d5e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:29.991705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:29.992550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:29.992864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:29.993547 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] PATH_INFO: `/v3/users/36591d5ee2964d2ab6195ec372000581` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:29.995156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=36591d5ee2964d2ab6195ec372000581)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:29.997467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:30.091380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36591d5ee2964d2ab6195ec372000581'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:30.092265 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36591d5ee2964d2ab6195ec372000581'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:30.093302 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36591d5ee2964d2ab6195ec372000581'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:30.111981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36591d5ee2964d2ab6195ec372000581'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:30.141067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fefb324b-2055-43bf-ac93-30a97a850cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36591d5ee2964d2ab6195ec372000581'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:30.180386 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1159/2362] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:29 2022] DELETE /identity/v3/users/36591d5ee2964d2ab6195ec372000581 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:30.182598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:30.183070 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:30.183369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:30.224393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:30.225713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:30.314789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:30.315682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:30.315682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:30.351155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:30.379166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] MFA Rules not processed for user `f920842016e14eb8b43ba27912116e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:30.386031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:30.405594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1204/2363] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:30.417375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:30.420333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:30.539063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1160/2364] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:30.555971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0690e0-0b71-4415-8315-e55223ba081b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:30.561728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:30.562445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:30.562810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:30.563089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:30.576818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:30.578458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50210445-67b9-4d10-a27c-a0a0becf8c41 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:30.591887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1205/2365] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:31.474802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:31.476354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:31.500508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1252-a026-4086-a716-214ae21cb026 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:31.513230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:31.513858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:31.514139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:31.514564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] PATH_INFO: `/v3/projects/283be17a6e0a4f84b77ebcde18597c96` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:31.515938 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283be17a6e0a4f84b77ebcde18597c96)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:31.518332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:31.629638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283be17a6e0a4f84b77ebcde18597c96', 'request_id': 'req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:31.641273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283be17a6e0a4f84b77ebcde18597c96', 'request_id': 'req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:31.659122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283be17a6e0a4f84b77ebcde18597c96', 'request_id': 'req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:31.693215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] The token cache is being invalidate because project 283be17a6e0a4f84b77ebcde18597c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:31.694450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:31.697999 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6a5787ac-ac45-4c0a-90f7-c6946a4adc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:31.711429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1161/2366] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:31 2022] DELETE /identity/v3/projects/283be17a6e0a4f84b77ebcde18597c96 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:31.713391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:31.714367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:31.714808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:31.790446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:31.791869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:31.805116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:31.937072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1206/2367] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:31.946250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:31.946538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:31.946868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:31.995334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:32.000012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:32.032665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1162/2368] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:32.037124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.051121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb632df9-b9f6-4e0a-8286-ac3c99ef648c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.061912 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.064271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.065800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.066316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.069043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:32.070623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.078432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.111142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1207/2369] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:31:32.116222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.134111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d8349-0b0f-4dbd-b49d-08e0e2b62b3b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.166242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.168100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.168391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.172444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.190148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.192122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.282775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1163/2370] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:32.285555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.297859 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac00d-307d-4dba-b39d-40646d3bfb9e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.541778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.542606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.543160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.543594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.544377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.546965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.606281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1208/2371] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:32 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:32.610076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.626793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8078-baa9-4be0-8052-5a909b366057 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.649429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.650369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.650752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.651144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.651883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.653866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.681513 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1164/2372] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:32.686255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.704016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30cbe9-134e-4b03-8acb-cdfbcef5a278 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.713201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.714079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.714967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.715443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.716467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.718728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2bd9-2b89-4beb-a643-b8e3550b878e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.736995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1209/2373] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:32.741637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:32.767431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609ca8-cd6f-4533-8031-05c444b61236 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:32.774854 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:32.775543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.775826 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.776157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] PATH_INFO: `/v3/projects/1d8f437f20ef4021bfd156583723c120/users/5bc62edf2e3e4c78a7f379b8850f3038/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.825946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8f437f20ef4021bfd156583723c120, user_id=5bc62edf2e3e4c78a7f379b8850f3038, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:32.834332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066f10d-8f0a-4c49-a142-fa624458bee8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:32.864833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1165/2374] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:32 2022] PUT /identity/v3/projects/1d8f437f20ef4021bfd156583723c120/users/5bc62edf2e3e4c78a7f379b8850f3038/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:32.877494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.877783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.878165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.904120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:32.904418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:32.904733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:32.956907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] MFA Rules not processed for user `5bc62edf2e3e4c78a7f379b8850f3038`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:32.958258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:32.962121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] MFA Rules not processed for user `770bb3ff0cb94295b9ee3af2552de05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:32.964025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:32.996430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:33.122837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1210/2375] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:33.135455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:33.137755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1166/2376] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:33.138138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:33.161961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:33.163864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:33.172706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:33.294776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51975dfd-f263-4dfb-a589-cd45c5d1f2fb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:33.307143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:33.307810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:33.308091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:33.316375 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:33.331301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50da24a-d48e-4d8b-a0a5-3f598d0230dc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:33.332357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:33.334038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2b4d5-165d-440c-b8f2-b159fa8ed2f6 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:33.337787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:33.338541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:33.338918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:33.339288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:33.341460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:33.359765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1211/2377] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:33.438527 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:33.441657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e24828-0510-4a42-8dba-09df373be20e service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:33.459721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1167/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:36.098334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:36.098334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:36.098334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:36.163692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] MFA Rules not processed for user `fa89a469af8a4bed82778f6c48f1d604`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:36.169001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:36.209317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1212/2379] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:37.506934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:37.507518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:37.507728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:37.549585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:37.552885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:37.660238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:37.675745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1168/2380] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:31:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:37.698086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:37.699619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:37.763810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:37.960544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895898d-a2c4-48b3-98d9-e2016e13d016 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:37.985567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:37.990783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:37.991412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:37.991861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:37.999785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6a95-fd92-4df3-86b1-b2a183f7d3a0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:38.017316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:38.024883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:38.024883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:38.025240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:38.025447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] PATH_INFO: `/v3/users/5bc62edf2e3e4c78a7f379b8850f3038` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:38.027295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7b194-0097-42a8-81ea-5c81f389fbbc service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:38.028966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc62edf2e3e4c78a7f379b8850f3038)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:38.037545 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:38.088508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1213/2381] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:31:38.216596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc62edf2e3e4c78a7f379b8850f3038'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:38.217365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc62edf2e3e4c78a7f379b8850f3038'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:38.217672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc62edf2e3e4c78a7f379b8850f3038'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:38.306988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc62edf2e3e4c78a7f379b8850f3038'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:38.355041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc62edf2e3e4c78a7f379b8850f3038'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:38.404585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1169/2382] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:37 2022] DELETE /identity/v3/users/5bc62edf2e3e4c78a7f379b8850f3038 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:38.406493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:38.406796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:38.407174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:38.454561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:38.455916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:38.639090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1214/2383] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:38.646178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:38.647646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:38.801456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25fad-035a-40fe-abf7-13adbd4026a0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:38.813913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:38.815072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:38.815355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:38.815626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:38.841749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:38.843244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682464e5-b116-4cb4-877a-79d7fc933a2b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:38.894410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1170/2384] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:39.503275 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:39.506738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:39.524255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ba8d-afc2-4781-ba37-71ef07eb40b2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:39.538392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:39.539317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:39.539755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:39.540373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] PATH_INFO: `/v3/projects/1d8f437f20ef4021bfd156583723c120` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:39.543596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8f437f20ef4021bfd156583723c120)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:39.546195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:39.594371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:39.614370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8f437f20ef4021bfd156583723c120', 'request_id': 'req-e4bb975d-7206-4619-ac09-5736edc4f2ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:39.620253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8f437f20ef4021bfd156583723c120', 'request_id': 'req-e4bb975d-7206-4619-ac09-5736edc4f2ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:39.630034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8f437f20ef4021bfd156583723c120', 'request_id': 'req-e4bb975d-7206-4619-ac09-5736edc4f2ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:39.662625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] The token cache is being invalidate because project 1d8f437f20ef4021bfd156583723c120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:39.663291 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:39.664651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:39.667686 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1215/2385] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:39 2022] DELETE /identity/v3/projects/1d8f437f20ef4021bfd156583723c120 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:43.355868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d08f-5a5c-417f-842f-8d4cbcce5776 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:43.356359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d08f-5a5c-417f-842f-8d4cbcce5776 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:43.356472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d08f-5a5c-417f-842f-8d4cbcce5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:43.375994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9050d08f-5a5c-417f-842f-8d4cbcce5776 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:43.377227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9050d08f-5a5c-417f-842f-8d4cbcce5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:43.390245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:43.432240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1171/2386] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:43.445466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:43.446858 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:43.516542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb975d-7206-4619-ac09-5736edc4f2ed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:43.521603 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:43.522214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:43.522495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:43.522768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:43.532150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:43.533751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:43.543127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1216/2387] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:31:43.800955 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eb2-2e76-48ff-ada8-cec8cad97492 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:43.801264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eb2-2e76-48ff-ada8-cec8cad97492 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:43.801570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0259eb2-2e76-48ff-ada8-cec8cad97492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:43.821856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d0259eb2-2e76-48ff-ada8-cec8cad97492 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:43.823568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d0259eb2-2e76-48ff-ada8-cec8cad97492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:43.836017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1172/2388] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:43.851102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:43.864182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619923-da49-444e-b482-385ed8037bc8 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:43.869459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:43.870064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:43.870346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:43.870619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:43.880785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:43.881334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:43.891756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1217/2389] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:31:44.265846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:44.266134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:44.266406 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:44.286889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:44.288098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:44.295528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1173/2390] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:31:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:44.307796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:44.319248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eceb5-5d96-423a-b3b3-b996f20568d3 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:44.324683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:44.326138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:44.326490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:44.326771 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:44.336719 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:44.338331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f542-5753-4716-a4ea-c41364c9429c service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:44.347451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1218/2391] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 06:31:46.669603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:46.671034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:46.734482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7eff-9a15-467f-97d1-6cc9674f45c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:46.738926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:46.739546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:46.739829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:46.740102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] PATH_INFO: `/v3/users/2ca33771bd0a4ceaabe014ffef14e87e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:46.741253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca33771bd0a4ceaabe014ffef14e87e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:46.743529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:46.790222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca33771bd0a4ceaabe014ffef14e87e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:46.790880 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca33771bd0a4ceaabe014ffef14e87e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:46.791509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca33771bd0a4ceaabe014ffef14e87e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:46.798364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca33771bd0a4ceaabe014ffef14e87e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:46.810192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca33771bd0a4ceaabe014ffef14e87e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:46.822226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1174/2392] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:31:46 2022] DELETE /identity/v3/users/2ca33771bd0a4ceaabe014ffef14e87e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:46.826854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:46.827317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:46.827433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:46.849273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:46.850538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:46.919179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1219/2393] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:46.928890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:46.930332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:46.965249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:46.990666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdcf06-d39d-4bf1-aee6-b4fae5748f2a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:46.994238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:46.994834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:46.995109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:46.995379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.004784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.006227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a207-f703-4af4-b1b3-984216368930 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.015382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1175/2394] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:47.191181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.192358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:47.206856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3363aa-efd5-4ba9-ab84-b45d5d3e8246 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.211810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.212619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.212803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.213669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] PATH_INFO: `/v3/projects/716abeafc8fa49ae95ad7addab8087f3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.216869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716abeafc8fa49ae95ad7addab8087f3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.218833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.238259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:47.281499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716abeafc8fa49ae95ad7addab8087f3', 'request_id': 'req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:47.289361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716abeafc8fa49ae95ad7addab8087f3', 'request_id': 'req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:47.298812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716abeafc8fa49ae95ad7addab8087f3', 'request_id': 'req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:47.312340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] The token cache is being invalidate because project 716abeafc8fa49ae95ad7addab8087f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:31:47.312340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:47.312669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-67dbbd00-be6b-4e4e-bc24-c285f91bdae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:31:47.314280 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1220/2395] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:31:47 2022] DELETE /identity/v3/projects/716abeafc8fa49ae95ad7addab8087f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:47.319647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.319925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.320198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.341398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:47.342691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:47.408756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1176/2396] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:47.417235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.417526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.417832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.437970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:47.439174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:47.447895 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1221/2397] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:47.452391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.462739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e556f9-95c9-476b-a8f5-d816d4f53a2c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.468080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.468937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.469148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.469460 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.470419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:31:47.470795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.472552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.494020 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.496998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1177/2398] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:31:47.516059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6b42e-cb2a-4635-840e-dec60c6a905a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.522323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.523138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.523455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.523745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.524460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.526416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.561319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1222/2399] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:31:47.562870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.576127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991d4ac-ee30-46f4-817f-aac7e3d8e947 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.645288 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.645957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.646250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.646563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.647413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.649134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.672289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1178/2400] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:31:47.676945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.695812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49688a8e-7033-4fc4-899c-4b2915a1439f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.702436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.703286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.703851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.704202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.705189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.707661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.724637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1223/2401] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:31:47.725837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.736618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c39fd-74f0-43fb-abee-82743a6aef0c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.741433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18662487-7757-4194-adcb-4114665466fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.742117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662487-7757-4194-adcb-4114665466fe admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.742427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662487-7757-4194-adcb-4114665466fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.742589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18662487-7757-4194-adcb-4114665466fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.743317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662487-7757-4194-adcb-4114665466fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.745219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18662487-7757-4194-adcb-4114665466fe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.759895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1179/2402] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:31:47.761117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.772089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c65df-7c32-4e7a-8f0b-db1ec418a8c3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.776820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.777601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.777929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.778149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] PATH_INFO: `/v3/projects/a47c305a5171443ba16bf93614463c19/users/e3e0b65b011b416f90697fd111d8a26d/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.793726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47c305a5171443ba16bf93614463c19, user_id=e3e0b65b011b416f90697fd111d8a26d, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:47.796485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:47.810522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1224/2403] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:31:47 2022] PUT /identity/v3/projects/a47c305a5171443ba16bf93614463c19/users/e3e0b65b011b416f90697fd111d8a26d/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:31:47.816603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd79f6-4d00-471f-895d-9458ff733259 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.816884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd79f6-4d00-471f-895d-9458ff733259 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.817156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd79f6-4d00-471f-895d-9458ff733259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.836482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-eadd79f6-4d00-471f-895d-9458ff733259 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:47.837730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eadd79f6-4d00-471f-895d-9458ff733259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:47.871983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:47.905173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1180/2404] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:47.912939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:47.914637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:47.958222 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4a6a-d289-40f0-8aa3-ffbdc2ee5d1c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.958796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4a6a-d289-40f0-8aa3-ffbdc2ee5d1c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.959296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4a6a-d289-40f0-8aa3-ffbdc2ee5d1c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.961493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1181/2405] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:31:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 06:31:47.968317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac844-ec0e-4a9a-aacb-5758db90b089 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.968876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac844-ec0e-4a9a-aacb-5758db90b089 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.969370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac844-ec0e-4a9a-aacb-5758db90b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.982650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57716-9ff3-45de-b82a-c4f8874bc6f8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:47.986667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:47.987759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:47.988051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:47.988330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:47.993585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8ffac844-ec0e-4a9a-aacb-5758db90b089 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:47.995038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8ffac844-ec0e-4a9a-aacb-5758db90b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.001731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:48.008605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:48.022185 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1225/2406] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:48.117405 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1182/2407] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:31:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:48.126029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:48.128334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.192678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:48.205488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012da807-5c1f-4955-aff4-4a9f128efdc8 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:48.210666 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:48.211523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.211869 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.212206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.226614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:48.229345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcb40a-7b22-4c16-9343-105306f6b075 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:48.241633 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1226/2408] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:48.335680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.335998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.336279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.337676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1183/2409] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:31:48.342435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7b51-fa27-4f33-976f-c305469fb12c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.342807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7b51-fa27-4f33-976f-c305469fb12c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.343195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f7b51-fa27-4f33-976f-c305469fb12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.364690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-775f7b51-fa27-4f33-976f-c305469fb12c None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:48.366012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-775f7b51-fa27-4f33-976f-c305469fb12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.375915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1227/2410] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:31:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:48.385065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:48.386831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.402023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b163-c485-4438-b080-b9e2c7a5ebbc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:48.406012 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:48.406654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.406942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.407190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.415864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:48.417382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73c2c-388e-43bb-80f3-0b3e94ddbead service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:48.426168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1184/2411] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:48.516800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e043-5357-49b5-acd3-1be546cc788d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.517008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e043-5357-49b5-acd3-1be546cc788d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.517338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e043-5357-49b5-acd3-1be546cc788d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.519398 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1228/2412] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:31:48.524925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d916-e401-43d6-bbb9-e2a38221a474 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.525243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d916-e401-43d6-bbb9-e2a38221a474 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.525499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d916-e401-43d6-bbb9-e2a38221a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.545498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a618d916-e401-43d6-bbb9-e2a38221a474 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:48.547325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a618d916-e401-43d6-bbb9-e2a38221a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.557072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1185/2413] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:48.569111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e043-5357-49b5-acd3-1be546cc788d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:48.587477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e043-5357-49b5-acd3-1be546cc788d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:48.591184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:48.591796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.592080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.592357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.603930 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:48.605426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:48.618110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1229/2414] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:48.741083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4c57-9d2a-4e5e-a4d9-df6d76ddf978 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.741602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4c57-9d2a-4e5e-a4d9-df6d76ddf978 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.741756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4c57-9d2a-4e5e-a4d9-df6d76ddf978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.786071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8bbd4c57-9d2a-4e5e-a4d9-df6d76ddf978 None None] MFA Rules not processed for user `e3e0b65b011b416f90697fd111d8a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:48.787340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8bbd4c57-9d2a-4e5e-a4d9-df6d76ddf978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.870841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1186/2415] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:48.883489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:48.884952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:48.960001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3b54-e0b0-4e27-b242-ce48828e772d service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:48.967929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:48.968810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:48.969158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:48.969495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:48.980838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:48.982346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6a043-3b55-4dd3-81c8-f07991484d3d service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:48.998305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1230/2416] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:31:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:31:50.595825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5687-2578-4911-8734-9943d765eeef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:50.597338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5687-2578-4911-8734-9943d765eeef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:50.597767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5687-2578-4911-8734-9943d765eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:50.618618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-728a5687-2578-4911-8734-9943d765eeef None None] MFA Rules not processed for user `e3e0b65b011b416f90697fd111d8a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:50.620122 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-728a5687-2578-4911-8734-9943d765eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:50.628166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1187/2417] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:31:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:31:52.103314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03ad5-4b20-4926-819a-ad12b59f29eb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:52.103744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03ad5-4b20-4926-819a-ad12b59f29eb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:52.103943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03ad5-4b20-4926-819a-ad12b59f29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:52.123718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-72c03ad5-4b20-4926-819a-ad12b59f29eb None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:31:52.125108 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72c03ad5-4b20-4926-819a-ad12b59f29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:52.184009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1231/2418] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:31:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:31:52.197105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5687-2578-4911-8734-9943d765eeef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:31:52.199104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-728a5687-2578-4911-8734-9943d765eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:31:52.243541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:52.286962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5687-2578-4911-8734-9943d765eeef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:31:52.292348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:31:52.293007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:31:52.293289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:31:52.293565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:31:52.302496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:31:52.304247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:31:52.313997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1188/2419] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:32:02.177072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=67 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:02.308983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=16 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:11.525268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df835-7908-44b2-907d-cfc251d46464 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:11.525769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df835-7908-44b2-907d-cfc251d46464 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:11.525872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df835-7908-44b2-907d-cfc251d46464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:11.550017 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-729df835-7908-44b2-907d-cfc251d46464 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:11.551267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-729df835-7908-44b2-907d-cfc251d46464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:11.559504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1232/2420] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:32:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:11.572050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:11.584184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0fc-a10b-4cb3-bc58-f8fb5567dd50 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:11.590008 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:11.591113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:11.591613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:11.592100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:11.602418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:11.604555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f1b0e-63ad-442c-80c7-7368951e319f service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:11.614359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1189/2421] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:32:17.519989 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729df835-7908-44b2-907d-cfc251d46464 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:17.522158 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-729df835-7908-44b2-907d-cfc251d46464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:17.610294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729df835-7908-44b2-907d-cfc251d46464 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:17.616951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:17.617585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:17.617871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:17.618149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:17.619952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:17.634427 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:17.636821 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:17.648789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1233/2422] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:32:21.222332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809af2e-c5fb-46f5-a9ae-2d59069bcc70 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:21.222814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809af2e-c5fb-46f5-a9ae-2d59069bcc70 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:21.223095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809af2e-c5fb-46f5-a9ae-2d59069bcc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:21.244978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1809af2e-c5fb-46f5-a9ae-2d59069bcc70 None None] MFA Rules not processed for user `f856533ec21848db82c0fef655013f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:21.246874 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1809af2e-c5fb-46f5-a9ae-2d59069bcc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:21.313515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1190/2423] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:32:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:23.637279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:23.646438 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336a3bb-4ec2-4de2-80ef-d7e230baee20 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:23.649978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:23.650566 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:23.650844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:23.651117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:23.652899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:23.726860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:23.728612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:23.745173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1234/2424] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:31.306515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=31 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:33.733942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=65 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:36.202159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ff6a-9fcb-42e1-8ed8-a4ccffc3ab45 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:36.202714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ff6a-9fcb-42e1-8ed8-a4ccffc3ab45 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:36.202714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ff6a-9fcb-42e1-8ed8-a4ccffc3ab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:36.226419 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7ff7ff6a-9fcb-42e1-8ed8-a4ccffc3ab45 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:36.228109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7ff7ff6a-9fcb-42e1-8ed8-a4ccffc3ab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:36.236685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1191/2425] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:36.264251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:36.265873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:36.284091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0bde5-5f66-4f79-b7f7-18598a809ab6 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:36.295112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:36.295747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:36.296030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:36.296307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:36.308358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:36.310746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:36.321196 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1235/2426] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:39.271427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9ca4-a8b9-48ed-a7ff-ada582d3d632 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:39.271946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9ca4-a8b9-48ed-a7ff-ada582d3d632 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:39.272080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9ca4-a8b9-48ed-a7ff-ada582d3d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:39.291269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b35a9ca4-a8b9-48ed-a7ff-ada582d3d632 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:39.292478 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b35a9ca4-a8b9-48ed-a7ff-ada582d3d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:39.300176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1192/2427] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:39.320055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:39.331469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ef533-12ec-4507-bc01-bab0a0939618 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:39.337354 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:39.337937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:39.338216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:39.338493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:39.346920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:39.348482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:39.358145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1236/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:42.518316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488cfa-701e-4964-b39b-fa7a01714ed2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:42.518831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488cfa-701e-4964-b39b-fa7a01714ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:42.518951 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488cfa-701e-4964-b39b-fa7a01714ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:42.538224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b7488cfa-701e-4964-b39b-fa7a01714ed2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:42.539400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7488cfa-701e-4964-b39b-fa7a01714ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:42.547139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1193/2429] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:42.568730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:42.579793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e6ce6-244c-49eb-80b2-123999f33421 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:42.585396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:42.586015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:42.586325 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:42.586616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:42.595017 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:42.596627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:42.606628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1237/2430] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:45.580900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e95-ed48-4a94-bdc5-4bcd172ed9a1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:45.581395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e95-ed48-4a94-bdc5-4bcd172ed9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:45.581508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e95-ed48-4a94-bdc5-4bcd172ed9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:45.601559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-412f0e95-ed48-4a94-bdc5-4bcd172ed9a1 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:45.602731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-412f0e95-ed48-4a94-bdc5-4bcd172ed9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:45.610681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1194/2431] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:45.629945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:45.641494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758757-9723-4fbb-b6de-db87954d1224 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:45.648823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:45.649678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:45.650119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:45.650587 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:45.662071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:45.663864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:45.673258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1238/2432] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:48.744891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb7090-a0b4-4765-8b3f-34dd9c0309ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:48.745797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb7090-a0b4-4765-8b3f-34dd9c0309ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:48.745797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb7090-a0b4-4765-8b3f-34dd9c0309ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:48.770364 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e7fb7090-a0b4-4765-8b3f-34dd9c0309ed None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:48.771685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e7fb7090-a0b4-4765-8b3f-34dd9c0309ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:48.779723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1195/2433] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:48.795086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:48.806625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580459-762c-458b-a1cb-f7f70de524b3 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:48.812140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:48.812773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:48.813058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:48.813331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:48.822334 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:48.823904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:48.836222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1239/2434] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:32:51.903441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8805bd-1bc4-4260-9845-4e3376188135 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:51.903971 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8805bd-1bc4-4260-9845-4e3376188135 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:51.904085 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8805bd-1bc4-4260-9845-4e3376188135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:51.923566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ff8805bd-1bc4-4260-9845-4e3376188135 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:32:51.924785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff8805bd-1bc4-4260-9845-4e3376188135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:51.932640 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1196/2435] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:32:51.947649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:32:51.949066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:32:51.965101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6f47-8fd3-44d3-99d3-ec321bae0135 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:32:51.970645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:32:51.971246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:32:51.971528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:32:51.971803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:32:51.980769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:32:51.982323 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7d97-cc1a-44e2-9650-99edf569c3be service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:32:51.991470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1240/2436] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:33:01.918808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=18 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:01.987351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=36 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:03.032289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74912-91ac-4b9d-94fe-de0abf7b8689 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:03.033168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74912-91ac-4b9d-94fe-de0abf7b8689 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:03.033168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74912-91ac-4b9d-94fe-de0abf7b8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:03.052304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-faa74912-91ac-4b9d-94fe-de0abf7b8689 None None] MFA Rules not processed for user `f920842016e14eb8b43ba27912116e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:03.053763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-faa74912-91ac-4b9d-94fe-de0abf7b8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:03.111408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1197/2437] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:33:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:09.491725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b335-5adb-4bda-8af1-edbdf99b90c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:09.492213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b335-5adb-4bda-8af1-edbdf99b90c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:09.492339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b335-5adb-4bda-8af1-edbdf99b90c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:09.512408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-43c3b335-5adb-4bda-8af1-edbdf99b90c0 None None] MFA Rules not processed for user `e3e0b65b011b416f90697fd111d8a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:09.513635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-43c3b335-5adb-4bda-8af1-edbdf99b90c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:09.520725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1241/2438] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:33:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:12.508133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:12.508662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:12.508822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:12.529473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] MFA Rules not processed for user `f534b7b5831d4dfc9da5641553c9f635`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:12.530692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:12.593454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1198/2439] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:33:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:19.507188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:22.581176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=50 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:24.860395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fdb-239e-4fe3-8147-b27f46bb31f9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:24.860907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fdb-239e-4fe3-8147-b27f46bb31f9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:24.861191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236fdb-239e-4fe3-8147-b27f46bb31f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:24.880254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-90236fdb-239e-4fe3-8147-b27f46bb31f9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:24.881476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90236fdb-239e-4fe3-8147-b27f46bb31f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:24.889299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1242/2440] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:24.916194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:33:24.930643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883b17-c74e-40c5-ac68-48c2ad15d8f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:33:24.938393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:33:24.939018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:24.939303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:24.939581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:24.948061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:33:24.949688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:33:24.959048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1199/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:33:29.143167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711da1a-6789-4ea3-aaf7-7c4ed848cbf8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:29.143718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711da1a-6789-4ea3-aaf7-7c4ed848cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:29.143718 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711da1a-6789-4ea3-aaf7-7c4ed848cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:29.163041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c711da1a-6789-4ea3-aaf7-7c4ed848cbf8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:29.164234 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c711da1a-6789-4ea3-aaf7-7c4ed848cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:29.172385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1243/2442] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:29.186432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:33:29.197609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bea75-d9fd-46b5-a9cb-addf86fa33be service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:33:29.203155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:33:29.203747 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:29.204033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:29.204312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:29.212440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:33:29.214599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:33:29.224003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1200/2443] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:33:33.276981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc24c2-3770-4e4b-820f-93180502935a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:33.278095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc24c2-3770-4e4b-820f-93180502935a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:33.278265 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc24c2-3770-4e4b-820f-93180502935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:33.300116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f9fc24c2-3770-4e4b-820f-93180502935a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:33.301678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f9fc24c2-3770-4e4b-820f-93180502935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:33.315413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1244/2444] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:33.329993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:33:33.343501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc9cc-ad80-4305-a6b3-39bced014dca service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:33:33.350400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:33:33.351113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:33.351464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:33.351822 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:33.363524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:33:33.365203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70e165-8df8-425e-b597-4b65dfc7ed4f service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:33:33.375496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1201/2445] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:33:35.460847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:35.461343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:35.461705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:35.483788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] MFA Rules not processed for user `f856533ec21848db82c0fef655013f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:35.485048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:35.492126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1245/2446] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:33:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:36.451690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93804-e7a9-49fd-ba97-6f304d22a402 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:36.452180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93804-e7a9-49fd-ba97-6f304d22a402 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:36.452275 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93804-e7a9-49fd-ba97-6f304d22a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:36.472466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1b93804-e7a9-49fd-ba97-6f304d22a402 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:36.473719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1b93804-e7a9-49fd-ba97-6f304d22a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:36.482240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1202/2447] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:36.497714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:33:36.510935 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4d46-5d5e-439e-95a5-cca0e3336107 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:33:36.516448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:33:36.517082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:36.517357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:36.517749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:36.526589 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:33:36.528188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:33:36.538131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1246/2448] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:33:39.654969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:39.655525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:39.655525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:39.675618 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:33:39.676841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:33:39.684776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1203/2449] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Sep 9 06:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:33:39.699247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:33:39.710315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cedb6-935b-420a-a2e9-f6cb6bd6cbd0 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:33:39.716368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:33:39.717033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:33:39.717321 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:33:39.717605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:33:39.725838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:33:39.727408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:33:39.737904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1247/2450] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:33:49.670324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=24 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:49.733393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=24 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:10.245034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:10.259415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b8c5-87ac-4f05-b899-f7953027e265 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:10.264978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:10.265754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:10.266103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:10.266445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] PATH_INFO: `/v3/users/e3e0b65b011b416f90697fd111d8a26d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:10.267694 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e0b65b011b416f90697fd111d8a26d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:10.269729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:10.319777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e0b65b011b416f90697fd111d8a26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.320670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e0b65b011b416f90697fd111d8a26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.321282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e0b65b011b416f90697fd111d8a26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.334045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e0b65b011b416f90697fd111d8a26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.351829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e0b65b011b416f90697fd111d8a26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.376307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1204/2451] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:34:10 2022] DELETE /identity/v3/users/e3e0b65b011b416f90697fd111d8a26d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:10.779412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:10.792430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6e8-0dd0-4936-8c13-46b67416ae97 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:10.858838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:10.859478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:10.859755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:10.860228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] PATH_INFO: `/v3/projects/a47c305a5171443ba16bf93614463c19` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:10.861458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47c305a5171443ba16bf93614463c19)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:10.863347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:10.916548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47c305a5171443ba16bf93614463c19', 'request_id': 'req-b7ea5160-23f1-4852-aff2-d9ad19559bd3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.924405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47c305a5171443ba16bf93614463c19', 'request_id': 'req-b7ea5160-23f1-4852-aff2-d9ad19559bd3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.934807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47c305a5171443ba16bf93614463c19', 'request_id': 'req-b7ea5160-23f1-4852-aff2-d9ad19559bd3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.950646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] The token cache is being invalidate because project a47c305a5171443ba16bf93614463c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:34:10.951073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.951829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:10.954073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1248/2452] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:34:10 2022] DELETE /identity/v3/projects/a47c305a5171443ba16bf93614463c19 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:12.256655 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:12.258208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:12.273939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9330c-8839-4303-a9a9-ae55fdb723b4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:12.337791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:12.338429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.338707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.338982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] PATH_INFO: `/v3/users/f920842016e14eb8b43ba27912116e17` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.340748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f920842016e14eb8b43ba27912116e17)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:12.342670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:12.391841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f920842016e14eb8b43ba27912116e17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.392452 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f920842016e14eb8b43ba27912116e17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.393098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f920842016e14eb8b43ba27912116e17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.400301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f920842016e14eb8b43ba27912116e17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.413073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6089a603-aa8c-4e33-b7b3-004e6210dd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f920842016e14eb8b43ba27912116e17'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.415038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:12.428910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1205/2453] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:34:12 2022] DELETE /identity/v3/users/f920842016e14eb8b43ba27912116e17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:12.604761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:12.606404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:12.623024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea5160-23f1-4852-aff2-d9ad19559bd3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:12.682367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:12.683056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.683343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.684635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] PATH_INFO: `/v3/projects/b01373df02f04ac69cffa1999656a836` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.685216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01373df02f04ac69cffa1999656a836)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:12.687277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:12.725763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:12.743472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01373df02f04ac69cffa1999656a836', 'request_id': 'req-543d4adf-ae05-4e57-80a3-217c3f0e51a1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.749004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01373df02f04ac69cffa1999656a836', 'request_id': 'req-543d4adf-ae05-4e57-80a3-217c3f0e51a1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.757697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01373df02f04ac69cffa1999656a836', 'request_id': 'req-543d4adf-ae05-4e57-80a3-217c3f0e51a1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.769490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] The token cache is being invalidate because project b01373df02f04ac69cffa1999656a836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:34:12.769814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.770439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-543d4adf-ae05-4e57-80a3-217c3f0e51a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:12.771908 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1249/2454] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:34:12 2022] DELETE /identity/v3/projects/b01373df02f04ac69cffa1999656a836 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:12.776918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.777204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.777995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.797786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:12.798962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:12.854900 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1206/2455] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:34:12.863204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.863491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.863767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.882836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:12.884012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:12.891772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1250/2456] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:12.896060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:12.906503 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1e6e1-8709-4fc9-959c-35440937cae7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:12.911219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:12.911820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.912102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.912379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.913074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:34:12.913385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:12.914983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:12.927246 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1207/2457] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:34:12.931461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:12.940518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cad40-5b2e-41a5-b5a6-1b65d41387f5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:12.945342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:12.945931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:12.946216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:12.946494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:12.947119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:12.949045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:12.977065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1251/2458] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:34:12 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:34:12.981473 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:12.991458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8465f-a06b-485f-98f4-f64fa15018a7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.047773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.048384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.048687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.048963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.049612 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.051522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.075212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1208/2459] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:34:12 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:34:13.079498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:13.089704 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea664e-48b8-4943-8d64-6cff94b1014f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.094913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.095509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.095789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.096060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.096739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.098302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.108243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1252/2460] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:34:13.112279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:13.122072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81118a-357a-4a7c-acde-cfd19a7db1d0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.126714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.127298 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.127577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.127850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.128485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.130091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810076ee-489d-4854-80a2-0be2cf877291 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.140837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1209/2461] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:34:13.144822 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:13.155042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb48f-22db-4168-94fc-7bb6d1185559 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.159675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.160245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.160525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.160830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] PATH_INFO: `/v3/projects/5fc3212c16ff43fda942f74f2925dbbe/users/da518b81a4604dccb098fa26514e444a/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.174891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc3212c16ff43fda942f74f2925dbbe, user_id=da518b81a4604dccb098fa26514e444a, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.177642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.191910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1253/2462] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:34:13 2022] PUT /identity/v3/projects/5fc3212c16ff43fda942f74f2925dbbe/users/da518b81a4604dccb098fa26514e444a/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:13.196923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.197207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.197479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.217916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:13.219090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:13.266603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:13.281060 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1210/2463] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:34:13.287620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:13.289364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:13.344559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0525e9-a49d-4160-a289-dc8e4d5d88c3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.348164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.348794 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.349090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.349602 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.362782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.364956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.379994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1254/2464] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:13.796232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:13.806242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e5cf-f82e-4f97-8943-50c6054baecc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:13.810522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:13.811127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:13.811413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:13.811686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:13.813500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:13.884672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:13.886548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab8912-696a-43ae-b03c-10bc3edaca86 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:13.898045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1211/2465] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:15.375504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:15.377040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:15.390282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0dc50-b979-4f2f-ac56-abc26ddb57dc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:15.394504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:15.395062 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:15.395350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:15.395628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:15.397564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:15.416259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:15.417962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:15.430481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1255/2466] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:17.474506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd887ef-fb2c-40ac-bdff-6efc5dcf20b0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:17.475083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd887ef-fb2c-40ac-bdff-6efc5dcf20b0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:17.475223 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd887ef-fb2c-40ac-bdff-6efc5dcf20b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:17.537983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ccd887ef-fb2c-40ac-bdff-6efc5dcf20b0 None None] MFA Rules not processed for user `da518b81a4604dccb098fa26514e444a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:17.539220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ccd887ef-fb2c-40ac-bdff-6efc5dcf20b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:17.623384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1212/2467] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:17.637857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:17.639337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:17.653642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb43dce-ecfd-4ba0-bd5e-2254492dcb35 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:17.665479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:17.666206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:17.666557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:17.666866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:17.676065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:17.677725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabae005-a64b-4083-985a-4eb5e6580d2e service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:17.687978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1256/2468] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:19.069793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:19.070299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:19.070299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:19.092543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] MFA Rules not processed for user `da518b81a4604dccb098fa26514e444a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:19.094040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:19.101769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1213/2469] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:22.158404 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:22.159625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:22.160115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:22.186217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:22.187806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:22.224184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:22.256725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1257/2470] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:34:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:22.319063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:22.321467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:22.452765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29073524-b1e2-474c-a9fb-ba3a6b5d2482 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:22.459289 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:22.460160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:22.460786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:22.462359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:22.474913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:22.478963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:22.481151 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:22.508595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1214/2471] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:29.251286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:29.253583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:29.355004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4bd80-163b-46c6-8e96-72830cb0542d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:29.359282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:29.360171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:29.360810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:29.361370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:29.363518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:29.450802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:29.452894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:29.472770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1258/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:32.490585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:34.227729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:34.239718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee631e-9f69-404d-9ef3-79acdf294b0f service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:34.245076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:34.245665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:34.245952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:34.246216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:34.247917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:34.305137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:34.306720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ec39-a121-44a9-87b8-5211451513a5 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:34.316175 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1215/2473] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:36.816111 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:36.817524 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:36.885373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaf4ab-ceb3-472d-b02c-b395c69587d0 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:36.890296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:36.890891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:36.891169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:36.891440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:36.893114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:36.904770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:36.906339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:36.915979 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1259/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:39.564751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:39.565548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:39.566041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:39.591351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:39.592605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:39.601617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1216/2475] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:34:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:39.615716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:39.626928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6809-c02c-4584-a3c6-d93b94ce87ba service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:39.631896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:39.632503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:39.632819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:39.633095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:39.641364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:39.642865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc9532-d5b9-41e2-a2cf-e44e1ae5456b service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:39.651239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1260/2476] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:48.679182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:48.688944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9d55-994d-427c-86fe-1d69d03e17c8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:48.692709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:48.693328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:48.693605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:48.693873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:48.695654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:48.705648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:48.707323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3fa7-fb1c-4247-bcd4-94b0b33f6591 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:48.716686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1217/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:49.648246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:52.294762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad967-91d5-4239-813d-89528fce61d0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.295437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad967-91d5-4239-813d-89528fce61d0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.295437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad967-91d5-4239-813d-89528fce61d0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.296693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1261/2478] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:34:52.302957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3741-fd61-45c1-a531-8301c311ade4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.303430 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3741-fd61-45c1-a531-8301c311ade4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.304761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3741-fd61-45c1-a531-8301c311ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.325088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-57bf3741-fd61-45c1-a531-8301c311ade4 None None] MFA Rules not processed for user `71c93648e7be470794a3282fd043c195`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:52.326267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57bf3741-fd61-45c1-a531-8301c311ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:52.333048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1218/2479] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:34:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:52.347862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad967-91d5-4239-813d-89528fce61d0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:52.359442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad967-91d5-4239-813d-89528fce61d0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:52.363457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:52.364200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.364695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.365135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.374030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:52.375456 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132859db-f996-4993-b11c-86234ebd0c38 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:52.385064 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1262/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:52.491068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041db9-124d-4017-911d-8000c1c021f4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.491352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041db9-124d-4017-911d-8000c1c021f4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.491628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041db9-124d-4017-911d-8000c1c021f4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.493039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1219/2481] 10.222.0.30 () {54 vars in 921 bytes} [Fri Sep 9 06:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 06:34:52.498489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.498777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.499056 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.518886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] MFA Rules not processed for user `6d7cab58d5cc49469cf0ba0180f19100`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:52.520181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:52.529755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1263/2482] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Sep 9 06:34:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:52.540475 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041db9-124d-4017-911d-8000c1c021f4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:52.551892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041db9-124d-4017-911d-8000c1c021f4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:52.555348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:52.555936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:52.556216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:52.556487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:52.571865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:52.573360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20897c32-3bf5-48cc-94e4-975fae3bd8ef service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:52.583939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1220/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:54.133388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:54.143409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997a3f-f88a-47e8-b620-e62d97580870 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:54.147204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:54.147818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:54.148117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:54.148423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:54.150194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:54.162651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:54.164050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:54.175045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1264/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:34:55.250698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:55.251190 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:55.251284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:55.270026 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:55.271229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:55.278408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1221/2485] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:34:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:55.291662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:55.303259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc540c-70ac-4b22-9fc2-d4efa7fe8039 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:55.309145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:55.309834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:55.310199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:55.310543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:55.318763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:55.320520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:55.328731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1265/2486] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:58.377832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:58.380274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:58.419645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0a08-b339-4dae-97ba-6183c31993fb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:58.429340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:58.430203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:58.430500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:58.430759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] PATH_INFO: `/v3/users/f856533ec21848db82c0fef655013f4d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:58.434962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f856533ec21848db82c0fef655013f4d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:58.437004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:58.488461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f856533ec21848db82c0fef655013f4d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.489467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f856533ec21848db82c0fef655013f4d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.490161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f856533ec21848db82c0fef655013f4d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.501174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f856533ec21848db82c0fef655013f4d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.515757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2bc68245-b73b-44c5-8a57-f45c6dd7dce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f856533ec21848db82c0fef655013f4d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.532937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1222/2487] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:34:58 2022] DELETE /identity/v3/users/f856533ec21848db82c0fef655013f4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:58.738304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:58.749791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e88-8e99-4756-89a4-1c2ae32cbd92 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:58.819569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:58.820199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:58.820479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:58.820795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] PATH_INFO: `/v3/projects/7d219d62aac64834adc56e6c14322a9e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:58.821894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d219d62aac64834adc56e6c14322a9e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:58.824256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:58.873378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d219d62aac64834adc56e6c14322a9e', 'request_id': 'req-500ecac9-d8e7-4541-9bac-6a5a51f837b6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.878789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d219d62aac64834adc56e6c14322a9e', 'request_id': 'req-500ecac9-d8e7-4541-9bac-6a5a51f837b6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.886054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d219d62aac64834adc56e6c14322a9e', 'request_id': 'req-500ecac9-d8e7-4541-9bac-6a5a51f837b6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.897535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] The token cache is being invalidate because project 7d219d62aac64834adc56e6c14322a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:34:58.897823 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.898468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-500ecac9-d8e7-4541-9bac-6a5a51f837b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:34:58.899925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1266/2488] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:34:58 2022] DELETE /identity/v3/projects/7d219d62aac64834adc56e6c14322a9e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:58.905040 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:58.905330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:58.905608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:58.926225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:58.927420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:58.945375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:58.988058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1223/2489] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:58.997005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:58.997296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:58.997571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.016779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:59.017973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:59.025691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1267/2490] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:59.029738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.039204 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9d292-6aea-4cf3-9171-2aa8eb2ed978 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.044714 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.045325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.045605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.045879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.046553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:34:59.046855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.048445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.060458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1224/2491] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:34:59.064796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.073844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdef99-495d-42cf-97a6-b23a73ae3d48 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.078436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.079024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.079306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.079581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.080201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.082124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.110738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1268/2492] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:34:59.114773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.124425 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6471d-3e60-4cc7-bb07-28b33c008a22 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.179325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.179928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.180205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.180477 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.181156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.183745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.205104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1225/2493] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:34:59.209192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.219734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a737da-d2ef-4a8c-bdab-522f8b6a3c92 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.224536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.225162 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.225442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.225711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.226371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.227945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.238689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1269/2494] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:34:59.242447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.253023 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f89c2-a7de-44a3-a3dc-9e4ed72459c0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.257873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.258530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.258809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.259084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.259727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.261412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf302a62-bc0c-4b0c-9573-76951f854041 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.271828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1226/2495] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:34:59.275788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.282440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:59.286263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea55571-10fd-41cd-9daf-b19ea9e9adff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.292741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.293548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.293993 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.294445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] PATH_INFO: `/v3/projects/9ba29d28a0524674b93a1bc35b8c11b3/users/76f453e3b3554ba4a2047a3d5a25cc23/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.308789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba29d28a0524674b93a1bc35b8c11b3, user_id=76f453e3b3554ba4a2047a3d5a25cc23, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.311396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.323949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1270/2496] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:34:59 2022] PUT /identity/v3/projects/9ba29d28a0524674b93a1bc35b8c11b3/users/76f453e3b3554ba4a2047a3d5a25cc23/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:59.333926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.334220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.334496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.362599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] MFA Rules not processed for user `76f453e3b3554ba4a2047a3d5a25cc23`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:59.363803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:59.434576 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1227/2497] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:59.439065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.503702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456dfa-a935-4eb7-8d08-1a6b6caf1fc6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.508146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.508768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.509052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.509326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.509952 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.512333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.538959 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1271/2498] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:34:59.543259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.554597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171e49-c76d-4577-bfc0-8189725c276a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.570827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:59.614376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.615079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.615359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.615640 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.616284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.618325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.640690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1228/2499] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:34:59.644964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.655699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98b83-3449-442b-ae1d-561566434d1f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.660329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.660974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.661257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.661537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.662202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.664385 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.675276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1272/2500] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:34:59.679535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.689627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72394b7-8b99-4382-a992-07da4ef5a413 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.694307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.694959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.695234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.695506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] PATH_INFO: `/v3/projects/3a028421bbf64740acf3b9ae3043c158/users/2fbd38a9e0894ebeb8ad88f30eb12733/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.711979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a028421bbf64740acf3b9ae3043c158, user_id=2fbd38a9e0894ebeb8ad88f30eb12733, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.715267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.732305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1229/2501] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:34:59 2022] PUT /identity/v3/projects/3a028421bbf64740acf3b9ae3043c158/users/2fbd38a9e0894ebeb8ad88f30eb12733/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:34:59.736457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.749929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70df26b-16c5-4612-b52a-f1d2aaad3eca admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.815353 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.815963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.816249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.816521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.817197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.818758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3272995-f9f5-4146-bdc0-85e56bd87fc0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.829038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1273/2502] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:34:59.833332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.843886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a695-dec1-4807-be3a-ad5c2a8bf6ee admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:34:59.848548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:34:59.849300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.849581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.849851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] PATH_INFO: `/v3/projects/3a028421bbf64740acf3b9ae3043c158/users/2fbd38a9e0894ebeb8ad88f30eb12733/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.851746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a028421bbf64740acf3b9ae3043c158, user_id=2fbd38a9e0894ebeb8ad88f30eb12733, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:34:59.854653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:34:59.865000 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1230/2503] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:34:59 2022] PUT /identity/v3/projects/3a028421bbf64740acf3b9ae3043c158/users/2fbd38a9e0894ebeb8ad88f30eb12733/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:34:59.877204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:34:59.877495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:34:59.877777 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:34:59.909033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] MFA Rules not processed for user `2fbd38a9e0894ebeb8ad88f30eb12733`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:34:59.910251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:34:59.951818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:59.980501 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1274/2504] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:34:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:34:59.992090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:34:59.993796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:00.049934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b267c4-fbd2-4ee4-8a63-ad4d9c92ccfa admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:00.053457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:00.054050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:00.054330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:00.054604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:00.122363 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:00.123783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:00.132495 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1231/2505] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:34:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:01.495695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:01.497132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:01.509829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1bf7d-78e4-45fb-af80-3590ab568759 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:01.514473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:01.515091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:01.515372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:01.515641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:01.525305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:01.526734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9daf1b-6a79-46f9-b70c-43b0d8d42ac1 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:01.538444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1275/2506] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:35:05.317864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:05.346901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:05.380550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413e068-1374-448c-ae8a-0f9f792e5baf service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:05.385260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:05.385885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:05.386164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:05.386466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] PATH_INFO: `/v3/users/76f453e3b3554ba4a2047a3d5a25cc23` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:05.387566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f453e3b3554ba4a2047a3d5a25cc23)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:05.389581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:05.441644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f453e3b3554ba4a2047a3d5a25cc23'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.442309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f453e3b3554ba4a2047a3d5a25cc23'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.442918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f453e3b3554ba4a2047a3d5a25cc23'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.450752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f453e3b3554ba4a2047a3d5a25cc23'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.462692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f453e3b3554ba4a2047a3d5a25cc23'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.475994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1232/2507] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:05 2022] DELETE /identity/v3/users/76f453e3b3554ba4a2047a3d5a25cc23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:05.480949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:05.481440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:05.481541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:05.500231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:05.501508 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:05.560536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1276/2508] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:05.570083 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:05.571483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:05.628584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afb63-6190-42b7-9ffb-8ce4937ab01a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:05.632192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:05.632963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:05.633252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:05.633523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:05.642426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:05.643839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:05.653109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1233/2509] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:05.917672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:05.919262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:05.932942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbc73f-25bf-4390-92d7-ea7997d91afb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:05.937460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:05.938089 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:05.938403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:05.939269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] PATH_INFO: `/v3/projects/9ba29d28a0524674b93a1bc35b8c11b3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:05.940581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba29d28a0524674b93a1bc35b8c11b3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:05.942541 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:05.989584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba29d28a0524674b93a1bc35b8c11b3', 'request_id': 'req-8d7a145e-634f-4b38-9d11-729f079d1d2a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:05.995014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba29d28a0524674b93a1bc35b8c11b3', 'request_id': 'req-8d7a145e-634f-4b38-9d11-729f079d1d2a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.002095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba29d28a0524674b93a1bc35b8c11b3', 'request_id': 'req-8d7a145e-634f-4b38-9d11-729f079d1d2a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.013298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] The token cache is being invalidate because project 9ba29d28a0524674b93a1bc35b8c11b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:06.013598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.014222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.015695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1277/2510] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:05 2022] DELETE /identity/v3/projects/9ba29d28a0524674b93a1bc35b8c11b3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:06.019748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.030030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd65e-1ff4-44a3-af02-c06806538247 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.073552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:06.086868 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.087494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.087776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.088048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] PATH_INFO: `/v3/users/2fbd38a9e0894ebeb8ad88f30eb12733` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.089722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbd38a9e0894ebeb8ad88f30eb12733)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.091654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.137011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbd38a9e0894ebeb8ad88f30eb12733'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.137584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbd38a9e0894ebeb8ad88f30eb12733'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.138202 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbd38a9e0894ebeb8ad88f30eb12733'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.144891 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbd38a9e0894ebeb8ad88f30eb12733'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.157104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-20804404-af04-4423-a9e1-0a9ead4fc07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbd38a9e0894ebeb8ad88f30eb12733'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.169657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1234/2511] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:06 2022] DELETE /identity/v3/users/2fbd38a9e0894ebeb8ad88f30eb12733 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:06.431675 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.433186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:06.452951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a145e-634f-4b38-9d11-729f079d1d2a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.498019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:06.512131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.512798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.513084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.513361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] PATH_INFO: `/v3/projects/3a028421bbf64740acf3b9ae3043c158` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.514470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a028421bbf64740acf3b9ae3043c158)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.516377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.563104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a028421bbf64740acf3b9ae3043c158', 'request_id': 'req-d0ba664a-3b6d-49db-a92a-1e6d80304cba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.568494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a028421bbf64740acf3b9ae3043c158', 'request_id': 'req-d0ba664a-3b6d-49db-a92a-1e6d80304cba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.576607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a028421bbf64740acf3b9ae3043c158', 'request_id': 'req-d0ba664a-3b6d-49db-a92a-1e6d80304cba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.587757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] The token cache is being invalidate because project 3a028421bbf64740acf3b9ae3043c158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:06.588042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.588713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d0ba664a-3b6d-49db-a92a-1e6d80304cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:06.590197 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1278/2512] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:06 2022] DELETE /identity/v3/projects/3a028421bbf64740acf3b9ae3043c158 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:06.595088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.595582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.595707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.615336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:06.616520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:06.674619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1235/2513] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:06.682151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.682922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.683221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.703663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:06.704880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:06.712689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1279/2514] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:06.716812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.726412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2925b-6dd9-48ff-ba27-73e0262b570f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.731278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.731871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.732152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.732426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.733112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:06.733424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.735021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.746735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1236/2515] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:06.750729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.760083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6924-0df9-4672-b643-e119aa4e8d09 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.765405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.765994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.766273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.766544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.767172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.769080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.795179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1280/2516] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:06 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:06.799306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.809666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541748c-eb74-4fcc-8da5-10e812c04f24 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.858490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:06.867077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.867871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.868215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.868699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.869340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.871843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.893035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1237/2517] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:06 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:06.897166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.907254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0b703-a4f8-4df6-8366-c7b6f4a75c60 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.911810 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.912406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.912829 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.913107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.913749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.915327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.925793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1281/2518] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:06.929459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.940021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf355-c844-45e9-b76e-185d74ccf567 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.944616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.945206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.945484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.945758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.946393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.947956 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2aaf3-a55b-4c8a-ac78-adf67f70e81c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:06.958362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1238/2519] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:06.962226 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:06.972397 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113309-2755-440c-abcd-43e3ae42335a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:06.976974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:06.977614 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:06.977892 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:06.978161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] PATH_INFO: `/v3/projects/bb3c4245e98c4513b0b37d92dbfff9c7/users/712fe65aeefa4c399798f844bf010654/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:06.993401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3c4245e98c4513b0b37d92dbfff9c7, user_id=712fe65aeefa4c399798f844bf010654, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:06.996687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.009222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1282/2520] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:06 2022] PUT /identity/v3/projects/bb3c4245e98c4513b0b37d92dbfff9c7/users/712fe65aeefa4c399798f844bf010654/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:07.019390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.019680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.019960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.047609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] MFA Rules not processed for user `712fe65aeefa4c399798f844bf010654`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:07.049096 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:07.111658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1239/2521] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:07.116021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.175401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdef3b-3cdb-459b-a9c5-486f96b8f7f0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.180210 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.180808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.181090 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.185752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.185752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.185752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.206208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:07.215102 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1283/2522] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:07 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:07.218783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.229754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6084a3-1464-44ea-ade1-83a87beb5a79 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.285148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.285752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.286034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.286307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.286943 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.288904 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.310931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1240/2523] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:07 2022] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:07.315073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.325788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c04a3-d6c1-4a8b-8dfd-783393f285a5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.330333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.330931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.331204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.331473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.332137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.333738 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.343971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1284/2524] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:07.347919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.358301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4dec-d097-419e-a079-f14cb9534a60 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.362853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.363489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.363768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.364042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] PATH_INFO: `/v3/projects/3dd4b8cecb494894939d027b893aead2/users/34389f20e55c4a0a8cee5d8e3df7a160/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.378739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd4b8cecb494894939d027b893aead2, user_id=34389f20e55c4a0a8cee5d8e3df7a160, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.381415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.394180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1241/2525] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:07 2022] PUT /identity/v3/projects/3dd4b8cecb494894939d027b893aead2/users/34389f20e55c4a0a8cee5d8e3df7a160/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:07.397966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.407649 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307f8b6-956e-4365-9215-ef72b34ff0f5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.463358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.463873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.464155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.464431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.465107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.466683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d3d44-2b35-4a9e-9048-1a4899bb620c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.476204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1285/2526] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:07.480506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.490542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c339cd-b438-4716-85e2-09f3d334ce98 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.495830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.496488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.496801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.497075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] PATH_INFO: `/v3/projects/3dd4b8cecb494894939d027b893aead2/users/34389f20e55c4a0a8cee5d8e3df7a160/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.499022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd4b8cecb494894939d027b893aead2, user_id=34389f20e55c4a0a8cee5d8e3df7a160, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.501752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.512373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1242/2527] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:07 2022] PUT /identity/v3/projects/3dd4b8cecb494894939d027b893aead2/users/34389f20e55c4a0a8cee5d8e3df7a160/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:07.523290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.523769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.523965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.551974 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] MFA Rules not processed for user `34389f20e55c4a0a8cee5d8e3df7a160`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:07.553198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:07.621139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1286/2528] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:07.631863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.633616 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:07.653994 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:07.692698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ab8f-b255-4b90-adb0-2f19c6421b79 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.696284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.696906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.697185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.697453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.706966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.708368 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.718285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1243/2529] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:07.793526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:07.802997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180e51-5705-4632-a1ed-f22aac9d26c2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:07.806575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:07.807180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:07.807461 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:07.807731 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:07.863231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:07.864707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ec78-6bbc-470e-85c2-645ba6ce96bd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:07.873384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1287/2530] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:11.925420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:11.987440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb1cd3-4f8a-464b-8bf3-8be0880f607f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:11.991875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:11.992494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:11.992801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:11.993074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] PATH_INFO: `/v3/users/712fe65aeefa4c399798f844bf010654` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:11.994165 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=712fe65aeefa4c399798f844bf010654)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:11.996087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:12.039828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712fe65aeefa4c399798f844bf010654'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.040401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712fe65aeefa4c399798f844bf010654'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.041024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712fe65aeefa4c399798f844bf010654'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.049278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712fe65aeefa4c399798f844bf010654'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.061666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712fe65aeefa4c399798f844bf010654'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.074084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1244/2531] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:11 2022] DELETE /identity/v3/users/712fe65aeefa4c399798f844bf010654 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:12.078623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:12.079097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:12.079213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:12.092711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:12.098767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:12.099947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:12.165240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1288/2532] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:12.175609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:12.177070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:12.220166 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:12.237339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e9d7-7f60-484e-a8b0-7869782487ff admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:12.240960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:12.241558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:12.241834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:12.242102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:12.250976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:12.252449 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:12.262167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1245/2533] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:12.536180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:12.538130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:12.552140 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccb92-6c0f-4a84-9025-d9f3fe78532a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:12.558183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:12.558966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:12.559317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:12.559841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] PATH_INFO: `/v3/projects/bb3c4245e98c4513b0b37d92dbfff9c7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:12.561164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3c4245e98c4513b0b37d92dbfff9c7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:12.563364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:12.621269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3c4245e98c4513b0b37d92dbfff9c7', 'request_id': 'req-205b10f3-d300-444c-b32c-a8f6f4954199'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.627001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3c4245e98c4513b0b37d92dbfff9c7', 'request_id': 'req-205b10f3-d300-444c-b32c-a8f6f4954199'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.636312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3c4245e98c4513b0b37d92dbfff9c7', 'request_id': 'req-205b10f3-d300-444c-b32c-a8f6f4954199'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.647833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] The token cache is being invalidate because project bb3c4245e98c4513b0b37d92dbfff9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:12.648120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.648775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.650279 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1289/2534] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:12 2022] DELETE /identity/v3/projects/bb3c4245e98c4513b0b37d92dbfff9c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:12.654360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:12.663936 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39d65-8d11-4353-8ef6-f328e5b92261 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:12.718834 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:12.719454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:12.719733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:12.720004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] PATH_INFO: `/v3/users/34389f20e55c4a0a8cee5d8e3df7a160` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:12.721134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34389f20e55c4a0a8cee5d8e3df7a160)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:12.723035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:12.768492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34389f20e55c4a0a8cee5d8e3df7a160'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.769171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34389f20e55c4a0a8cee5d8e3df7a160'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.769775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34389f20e55c4a0a8cee5d8e3df7a160'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.776525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34389f20e55c4a0a8cee5d8e3df7a160'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.788588 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ca406918-d72e-40c1-83cb-faf39d85f6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34389f20e55c4a0a8cee5d8e3df7a160'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:12.801300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1246/2535] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:12 2022] DELETE /identity/v3/users/34389f20e55c4a0a8cee5d8e3df7a160 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:13.075315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.076749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:13.090143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b10f3-d300-444c-b32c-a8f6f4954199 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.154676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.155225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.155506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.155781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] PATH_INFO: `/v3/projects/3dd4b8cecb494894939d027b893aead2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.156939 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd4b8cecb494894939d027b893aead2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.158807 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.194393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:13.209074 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd4b8cecb494894939d027b893aead2', 'request_id': 'req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:13.214762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd4b8cecb494894939d027b893aead2', 'request_id': 'req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:13.222894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd4b8cecb494894939d027b893aead2', 'request_id': 'req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:13.234918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] The token cache is being invalidate because project 3dd4b8cecb494894939d027b893aead2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:13.235246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:13.235924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a3182e2a-41fd-4ff1-a9d0-092443eb6a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:13.237577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1290/2536] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:13 2022] DELETE /identity/v3/projects/3dd4b8cecb494894939d027b893aead2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:13.242529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.243035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.243156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.263493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:13.264757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:13.314810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:13.324809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1247/2537] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:13.332065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.332355 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.332673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.352477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:13.353735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:13.362317 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1291/2538] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:13.366413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.376253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd10b3-7fe0-488a-84b8-b85abcd70835 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.380803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.381397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.381672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.381967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.382605 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:13.382907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.384512 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.395737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1248/2539] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:13.399847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.409391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05cc31-d718-480d-a8b7-ae349af83bcd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.413927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.414517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.414801 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.415076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.415695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.418221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.444264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1292/2540] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:13.448453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.458393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721bf2-32c7-4394-8079-0220a595aa10 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.523670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.524279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.524559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.524863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.525563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.527966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.549787 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1249/2541] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:13.554011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.564270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83800be-343e-41ec-893d-bef17a9d00bd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.568885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.569479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.569765 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.570042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.570711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.572294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.582087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1293/2542] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:13.586034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.596239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4710-cefc-41a1-b8e0-7de9172e954f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.600808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.601394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.601671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.601946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.602572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.605198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87827bcd-b0c1-4543-adde-4e9da9b7f2fb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.615472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1250/2543] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:13.619455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.629326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f02e-cf58-4c2e-ade8-b56546e8ff00 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.634029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.634681 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.634967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.635480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] PATH_INFO: `/v3/projects/e3aef5c1a25f48ffa11f803e9dfe7c6f/users/31621e913aa24b77a0dea07f53e07c46/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.650084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aef5c1a25f48ffa11f803e9dfe7c6f, user_id=31621e913aa24b77a0dea07f53e07c46, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.653293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.668110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1294/2544] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:13 2022] PUT /identity/v3/projects/e3aef5c1a25f48ffa11f803e9dfe7c6f/users/31621e913aa24b77a0dea07f53e07c46/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:13.677846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.678133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.678409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.707052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] MFA Rules not processed for user `31621e913aa24b77a0dea07f53e07c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:13.708285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:13.775326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1251/2545] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:13.780187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.842938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571b2f-7271-491b-af6e-11f656f19b30 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.848505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.849288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.849860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.850233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.850975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.852990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.890507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1295/2546] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:13.891695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:13.904072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28510-d726-4ea8-b55f-92ca92653407 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:13.955517 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:13.965856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:13.966561 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:13.966836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:13.967104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:13.967749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:13.969716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:13.992210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1252/2547] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:13 2022] POST /identity/v3/users => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:13.996470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.006917 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b6a6b-67ac-4349-b9b8-2b41a2a66b97 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.012087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.012727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.013005 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.013304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.013971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.015556 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.027769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1296/2548] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:14.031985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.042281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968106e-340f-4683-ad97-3ac3711ae5a2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.047021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.047674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.047952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.048256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] PATH_INFO: `/v3/projects/d994704c96c34c2493c3fc3690c9c246/users/2399bb7d684e4d52b758ebc1881caac9/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.063824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d994704c96c34c2493c3fc3690c9c246, user_id=2399bb7d684e4d52b758ebc1881caac9, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.066532 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.078998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1253/2549] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:14 2022] PUT /identity/v3/projects/d994704c96c34c2493c3fc3690c9c246/users/2399bb7d684e4d52b758ebc1881caac9/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:14.082870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.092640 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0391c-5a81-4d38-b267-bc92f6766530 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.241790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:14.271749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.272346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.272655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.272929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.273586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.275154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bff93a-d11f-494e-9214-83d2b213ddee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.284520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1297/2550] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:14.288745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.298704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540847-e74a-41aa-ba9a-96aa8d3e7911 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.303163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.303809 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.304086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.304356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] PATH_INFO: `/v3/projects/d994704c96c34c2493c3fc3690c9c246/users/2399bb7d684e4d52b758ebc1881caac9/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.306254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d994704c96c34c2493c3fc3690c9c246, user_id=2399bb7d684e4d52b758ebc1881caac9, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.309373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.319033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1254/2551] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:14 2022] PUT /identity/v3/projects/d994704c96c34c2493c3fc3690c9c246/users/2399bb7d684e4d52b758ebc1881caac9/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:14.330727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.331018 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.331296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.358955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] MFA Rules not processed for user `2399bb7d684e4d52b758ebc1881caac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:14.360154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:14.427407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1298/2552] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:14 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:14.439005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.440779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:14.496496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb611-9ad7-482e-9b49-0b96433a9543 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.500125 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.500774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.501059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.501334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.510395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.511857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.521208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1255/2553] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:14 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:14.670400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:14.679737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68b183-c990-47cf-9a19-289d3cba3591 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:14.683969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:14.684581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:14.684875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:14.685259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:14.740770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:14.742175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dca204-c581-44cc-8204-2efc08cca4aa service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:14.751468 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1299/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:14 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:20.011919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:20.071848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944aa2b-ee8c-48ba-93be-45619e63797a service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:20.077103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:20.077717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:20.077993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:20.078264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] PATH_INFO: `/v3/users/31621e913aa24b77a0dea07f53e07c46` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:20.079358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31621e913aa24b77a0dea07f53e07c46)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:20.081305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:20.125821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31621e913aa24b77a0dea07f53e07c46'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.126486 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31621e913aa24b77a0dea07f53e07c46'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.127108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31621e913aa24b77a0dea07f53e07c46'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.131623 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:20.136328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31621e913aa24b77a0dea07f53e07c46'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.149479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31621e913aa24b77a0dea07f53e07c46'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.164919 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1256/2555] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:20 2022] DELETE /identity/v3/users/31621e913aa24b77a0dea07f53e07c46 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:20.170808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:20.171273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:20.171368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:20.193246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:20.194449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:20.238201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:20.252737 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1300/2556] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:20.262957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:20.264435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:20.323703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa0579-5f47-4de4-86ea-77713b24dd0d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:20.327252 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:20.327843 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:20.328120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:20.328465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:20.337236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:20.338676 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:20.347864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1257/2557] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:35:20.614302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:20.615746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:20.627832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f02a7-cb49-4d00-95ef-2f5e7318ec69 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:20.632377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:20.633131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:20.633414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:20.633687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] PATH_INFO: `/v3/projects/e3aef5c1a25f48ffa11f803e9dfe7c6f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:20.635146 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3aef5c1a25f48ffa11f803e9dfe7c6f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:20.636685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:20.683478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3aef5c1a25f48ffa11f803e9dfe7c6f', 'request_id': 'req-71f152c3-95aa-4e89-98c1-7dc202de0435'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.688907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3aef5c1a25f48ffa11f803e9dfe7c6f', 'request_id': 'req-71f152c3-95aa-4e89-98c1-7dc202de0435'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.695802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3aef5c1a25f48ffa11f803e9dfe7c6f', 'request_id': 'req-71f152c3-95aa-4e89-98c1-7dc202de0435'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.707216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] The token cache is being invalidate because project e3aef5c1a25f48ffa11f803e9dfe7c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:20.707507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.708132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.709609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1301/2558] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:20 2022] DELETE /identity/v3/projects/e3aef5c1a25f48ffa11f803e9dfe7c6f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:20.713470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:20.722901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2dcb4-8326-4afc-b294-bbb67c2f3e5f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:20.779617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:20.780255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:20.780536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:20.780848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] PATH_INFO: `/v3/users/2399bb7d684e4d52b758ebc1881caac9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:20.781970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2399bb7d684e4d52b758ebc1881caac9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:20.783922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:20.833074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2399bb7d684e4d52b758ebc1881caac9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.833746 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2399bb7d684e4d52b758ebc1881caac9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.834349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2399bb7d684e4d52b758ebc1881caac9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.841668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2399bb7d684e4d52b758ebc1881caac9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.853352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-36806a59-725c-4762-af92-7beb4ebd43bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2399bb7d684e4d52b758ebc1881caac9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:20.855649 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:20.868269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1258/2559] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:20 2022] DELETE /identity/v3/users/2399bb7d684e4d52b758ebc1881caac9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:21.147609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.149163 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:21.164294 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f152c3-95aa-4e89-98c1-7dc202de0435 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.222530 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.223150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.223430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.223705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] PATH_INFO: `/v3/projects/d994704c96c34c2493c3fc3690c9c246` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.224843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d994704c96c34c2493c3fc3690c9c246)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.226739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.273557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd994704c96c34c2493c3fc3690c9c246', 'request_id': 'req-583f737c-b9fa-4d53-8b65-55c0ed04541f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:21.278951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd994704c96c34c2493c3fc3690c9c246', 'request_id': 'req-583f737c-b9fa-4d53-8b65-55c0ed04541f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:21.286195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd994704c96c34c2493c3fc3690c9c246', 'request_id': 'req-583f737c-b9fa-4d53-8b65-55c0ed04541f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:21.297750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] The token cache is being invalidate because project d994704c96c34c2493c3fc3690c9c246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:21.298037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:21.298669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-583f737c-b9fa-4d53-8b65-55c0ed04541f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:21.300152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1302/2560] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:21 2022] DELETE /identity/v3/projects/d994704c96c34c2493c3fc3690c9c246 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:21.305098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.305571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.305692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.325516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:21.326697 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:21.385227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1259/2561] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:21.393068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.393299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.393571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.402052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:21.415866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:21.417585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:21.425358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1303/2562] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:21.429563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.446859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed815e6-cec1-4e19-90ca-c59fa23d9b33 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.451511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.452146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.452426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.452744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.453388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:21.453693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.455296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.466713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1260/2563] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:21.471194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.481028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55645ea-c212-4ac6-8896-4cbab39a44ab None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.485584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.486166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.486444 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.486712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.487333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.489277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.515907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1304/2564] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:21.520071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.530325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f15768-1aff-4bfb-96d3-b8f3c8fb6a3e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.585284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.585885 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.586162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.586432 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.587052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.589522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.611853 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1261/2565] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:21 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:21.615778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.625751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fc78b-ec8f-4621-86bd-c523957967a7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.630246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.630828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.631106 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.631373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.631999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.633598 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.643744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1305/2566] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:21.647328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.657594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e6475-98d2-4404-bb63-3c2e0e96e36f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.662352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.663002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.663254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.663540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.664184 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.665788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff106a-977a-460c-9f82-e1b1c1398875 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.676898 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1262/2567] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:21.680919 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.690697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f7a7-b29f-49c3-ac12-18127fff056b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.695422 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.695977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.696255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.696528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] PATH_INFO: `/v3/projects/6ad8ccd5cefd48f8abea4258e864d0dd/users/019391906b4d4833842227814faf70c6/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.710734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad8ccd5cefd48f8abea4258e864d0dd, user_id=019391906b4d4833842227814faf70c6, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.713871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.726400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1306/2568] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:21 2022] PUT /identity/v3/projects/6ad8ccd5cefd48f8abea4258e864d0dd/users/019391906b4d4833842227814faf70c6/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:21.738281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.738566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.738837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.766053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] MFA Rules not processed for user `019391906b4d4833842227814faf70c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:21.767309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:21.810567 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:21.830566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1263/2569] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:21.842259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:21.843948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:21.899268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ed2e9-5ee6-41ff-99e6-309b7bb7f10b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:21.903297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:21.903891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:21.904172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:21.904446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:21.912467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:21.913964 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0d7c0-a432-4cf1-863f-7e48e2780266 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:21.923145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1307/2570] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:21.942086 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.004076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f9e92-59da-4bd4-9a71-b4953058b766 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.008765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.009384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.009664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.010450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] PATH_INFO: `/v3/users/019391906b4d4833842227814faf70c6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.011572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019391906b4d4833842227814faf70c6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.013560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.058713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019391906b4d4833842227814faf70c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.059372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019391906b4d4833842227814faf70c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.059988 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019391906b4d4833842227814faf70c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.066985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019391906b4d4833842227814faf70c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.079214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019391906b4d4833842227814faf70c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.092609 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1264/2571] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:21 2022] DELETE /identity/v3/users/019391906b4d4833842227814faf70c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:22.097208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.097493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.097769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.116661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:22.117837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:22.187612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1308/2572] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:22.197049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.199239 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:22.264831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d4ce8-1b77-474a-9891-c911defb5172 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.268622 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.269238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.269523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.269793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.279892 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.281353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e18e29-ad75-4dcf-b96c-97227abacdc7 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.291091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1265/2573] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:35:22.570424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.571899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:22.584688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49b81-cca4-4800-b60d-355e6712a4b7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.589626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.590338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.590626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.590900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] PATH_INFO: `/v3/projects/6ad8ccd5cefd48f8abea4258e864d0dd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.592047 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad8ccd5cefd48f8abea4258e864d0dd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.594094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.637428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:22.646118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad8ccd5cefd48f8abea4258e864d0dd', 'request_id': 'req-ff10be36-247c-49cd-a65c-012d0596f5e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.652124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad8ccd5cefd48f8abea4258e864d0dd', 'request_id': 'req-ff10be36-247c-49cd-a65c-012d0596f5e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.659762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad8ccd5cefd48f8abea4258e864d0dd', 'request_id': 'req-ff10be36-247c-49cd-a65c-012d0596f5e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.672476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] The token cache is being invalidate because project 6ad8ccd5cefd48f8abea4258e864d0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:22.672901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.673546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ff10be36-247c-49cd-a65c-012d0596f5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:22.675242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1309/2574] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:22 2022] DELETE /identity/v3/projects/6ad8ccd5cefd48f8abea4258e864d0dd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:22.679815 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.680277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.680487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.700346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:22.701575 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:22.705779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:22.765340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1266/2575] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:22.773040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.773429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.773710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.793916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:22.795114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:22.803055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1310/2576] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:22.808039 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.819673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d562-04b3-466a-8810-619cc5a29063 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.825009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.825671 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.825932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.826207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.826861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:22.827172 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.828832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.841255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1267/2577] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:22.845696 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.855698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7db30-e387-4f5a-bfa0-cdf5957a48a3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.860303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.860937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.861222 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.861531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.862166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.864079 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.894995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1311/2578] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:22.896799 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:22.906696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac43a8a-eb38-47df-a67e-027ea5e529a6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:22.962617 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:22.963148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:22.963433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:22.963708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:22.964348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:22.966305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:22.987316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1268/2579] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:22 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:22.991548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.002694 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0742-18da-4c66-a66c-832ee8fd30ca admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.007558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.008152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.008435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.008740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.009376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.010981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.020626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1312/2580] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:23.024553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.034940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cdf4-49da-4086-b3d0-9219b3edfec7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.039593 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.040210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.040520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.040832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.042110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.043690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791c65d-03b0-4913-8ace-14d58d24bf39 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.054200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1269/2581] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:23.058044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.067616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e09dc-d2a4-424c-b201-76f407ddc90d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.072173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.072990 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.073313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.073599 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] PATH_INFO: `/v3/projects/8b5a440238f24f1ea6d94738689ec4bc/users/7a4269731d9d4d8a9e2ab85e77ea878c/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.088677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5a440238f24f1ea6d94738689ec4bc, user_id=7a4269731d9d4d8a9e2ab85e77ea878c, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.091389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.105969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1313/2582] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:23 2022] PUT /identity/v3/projects/8b5a440238f24f1ea6d94738689ec4bc/users/7a4269731d9d4d8a9e2ab85e77ea878c/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:23.116067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.116358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.116667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.143855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] MFA Rules not processed for user `7a4269731d9d4d8a9e2ab85e77ea878c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:23.145318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:23.217833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1270/2583] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:23.226878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.294396 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acf71-933a-49cd-89cc-449c91d88251 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.299340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.299944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.300228 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.300505 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.301169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.303027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.330632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1314/2584] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:23.333504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.340537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:23.344957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d323-043e-4b00-8bbe-55433b9ee1f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.403498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.404362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.404846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.405118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.405748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.407705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.432189 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1271/2585] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:23.436186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.446559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a070-5e83-4c6b-b19b-540ef1bc74a3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.451744 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.452346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.452657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.452931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.453567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.455137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.467237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1315/2586] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:23.471494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.481973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f041cf-1503-4c85-94b8-ee3f3be484e6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.486666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.487262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.487539 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.487808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.488444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.490048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ba419-37e6-48e0-aeb8-1eaa5458650c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.500054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1272/2587] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:23.504285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.515326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86f30-6a54-41c0-833c-08fb31955926 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.520885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.522337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.522784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.523348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] PATH_INFO: `/v3/projects/7b5d891ab7b541619706cccd2980bac9/users/49e91f10875c4b4da725ec79b7d8b176/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.541218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d891ab7b541619706cccd2980bac9, user_id=49e91f10875c4b4da725ec79b7d8b176, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.545189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.558802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1316/2588] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:23 2022] PUT /identity/v3/projects/7b5d891ab7b541619706cccd2980bac9/users/49e91f10875c4b4da725ec79b7d8b176/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:23.570550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.570833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.571103 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.599462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] MFA Rules not processed for user `49e91f10875c4b4da725ec79b7d8b176`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:23.600690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:23.664757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1273/2589] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:23.670295 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.683663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:23.734967 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaa74-c9e7-4499-9f91-db5a7a3d77e8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.739464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.740063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.740347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.740662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.741298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.743169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.770395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1317/2590] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:23.774447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.785805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22415e3-6b6c-4029-810d-c839f22a2156 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.843133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.843739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.844017 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.844287 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.844969 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.847161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.871394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1274/2591] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:23 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:23.875429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.886098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa02a5-0bfb-4d9d-a771-6f57dd030ccd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.890870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.891387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.891670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.891945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.892604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.894190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.904455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1318/2592] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:23.908463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.913668 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:23.919964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf53f1-934c-49ab-b499-0e49a206ae2e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:23.924865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:23.925511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:23.925789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:23.926092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] PATH_INFO: `/v3/projects/ee62cb7f788642b6a923f024020327b0/users/2e6924a793d74f82834bd4089203ebe9/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:23.941153 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee62cb7f788642b6a923f024020327b0, user_id=2e6924a793d74f82834bd4089203ebe9, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:23.943800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:23.957255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1275/2593] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:23 2022] PUT /identity/v3/projects/ee62cb7f788642b6a923f024020327b0/users/2e6924a793d74f82834bd4089203ebe9/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:23.961266 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:23.971045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e189c6-7999-4276-8f28-19591e6c4a49 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:24.027654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:24.028182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:24.028464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:24.028770 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:24.029401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:24.030970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ef1ec-d422-4cde-b649-ee7843f703ea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:24.040778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1319/2594] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:24.045768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:24.055793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0ba7-493a-49c0-92ef-107adce5bea9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:24.060910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:24.061558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:24.061841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:24.062138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] PATH_INFO: `/v3/projects/ee62cb7f788642b6a923f024020327b0/users/2e6924a793d74f82834bd4089203ebe9/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:24.064035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee62cb7f788642b6a923f024020327b0, user_id=2e6924a793d74f82834bd4089203ebe9, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:24.066700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:24.077277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1276/2595] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:24 2022] PUT /identity/v3/projects/ee62cb7f788642b6a923f024020327b0/users/2e6924a793d74f82834bd4089203ebe9/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:24.089116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:24.089411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:24.089687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:24.118058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] MFA Rules not processed for user `2e6924a793d74f82834bd4089203ebe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:24.119787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:24.194221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1320/2596] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:24.206206 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:24.207964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:24.265080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e2057-e879-493b-8172-b48ec535c534 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:24.268721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:24.269317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:24.269599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:24.269872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:24.324970 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:24.326325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:24.335011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1277/2597] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:25.872029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:25.874186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:25.886307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006bba2-cf0c-498f-b45e-19473778635e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:25.889934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:25.890610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:25.890957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:25.891297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:25.897855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:25.953960 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:25.955304 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:25.965065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1321/2598] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:26.512437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:26.521021 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e1fa-7391-454c-9167-97e8372aa8e3 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:26.524775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:26.525636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:26.526113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:26.526568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:26.536267 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:26.537705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c616ba-389c-42e3-94c0-26d290016843 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:26.547846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1278/2599] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:30.449400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:30.520274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d229c-d189-4fd2-8337-28fb65091112 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:30.533348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:30.533348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:30.533348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:30.533348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] PATH_INFO: `/v3/users/7a4269731d9d4d8a9e2ab85e77ea878c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:30.533764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4269731d9d4d8a9e2ab85e77ea878c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:30.535169 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:30.595011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4269731d9d4d8a9e2ab85e77ea878c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:30.608095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4269731d9d4d8a9e2ab85e77ea878c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:30.608813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4269731d9d4d8a9e2ab85e77ea878c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:30.615693 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4269731d9d4d8a9e2ab85e77ea878c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:30.616328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4269731d9d4d8a9e2ab85e77ea878c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:30.630251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1322/2600] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:30 2022] DELETE /identity/v3/users/7a4269731d9d4d8a9e2ab85e77ea878c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:30.634754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:30.635249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:30.635391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:30.655624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:30.656870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:30.719870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1279/2601] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:30.730590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:30.732802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:30.765870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:30.797637 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d352-e79e-462e-a8bf-a498f4f7dc36 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:30.801632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:30.802239 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:30.802522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:30.802796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:30.813561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:30.814970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:30.824887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1323/2602] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:31.112785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:31.114335 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:31.128725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd6c3a-7f07-4d9f-9f2f-c6529e58b46d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:31.133344 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:31.133997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:31.134253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:31.134520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] PATH_INFO: `/v3/projects/8b5a440238f24f1ea6d94738689ec4bc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:31.135643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5a440238f24f1ea6d94738689ec4bc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:31.138294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:31.140076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:31.190586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5a440238f24f1ea6d94738689ec4bc', 'request_id': 'req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.196841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5a440238f24f1ea6d94738689ec4bc', 'request_id': 'req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.202327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5a440238f24f1ea6d94738689ec4bc', 'request_id': 'req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.215310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] The token cache is being invalidate because project 8b5a440238f24f1ea6d94738689ec4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:31.215586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.216200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.217756 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1280/2603] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:31 2022] DELETE /identity/v3/projects/8b5a440238f24f1ea6d94738689ec4bc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:31.221674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:31.235560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81a095-4606-4ba1-aa73-83274d205e89 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:31.296316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:31.296972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:31.297251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:31.297521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] PATH_INFO: `/v3/users/49e91f10875c4b4da725ec79b7d8b176` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:31.298642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e91f10875c4b4da725ec79b7d8b176)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:31.300584 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:31.349581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e91f10875c4b4da725ec79b7d8b176'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.362370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e91f10875c4b4da725ec79b7d8b176'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.363087 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e91f10875c4b4da725ec79b7d8b176'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.372231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e91f10875c4b4da725ec79b7d8b176'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.372890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e91f10875c4b4da725ec79b7d8b176'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.386973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1324/2604] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:31 2022] DELETE /identity/v3/users/49e91f10875c4b4da725ec79b7d8b176 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:31.666099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:31.667707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:31.696301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10d3c7-d8d8-4c2e-b396-12c368a0c0fe admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:31.766643 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:31.768003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:31.768402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:31.768932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] PATH_INFO: `/v3/projects/7b5d891ab7b541619706cccd2980bac9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:31.771160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5d891ab7b541619706cccd2980bac9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:31.773225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:31.967890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5d891ab7b541619706cccd2980bac9', 'request_id': 'req-69309116-fb2b-46d7-9419-ca039b05cd91'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.974291 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5d891ab7b541619706cccd2980bac9', 'request_id': 'req-69309116-fb2b-46d7-9419-ca039b05cd91'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.981320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5d891ab7b541619706cccd2980bac9', 'request_id': 'req-69309116-fb2b-46d7-9419-ca039b05cd91'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.996109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] The token cache is being invalidate because project 7b5d891ab7b541619706cccd2980bac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:31.996401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.997071 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:31.998840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1281/2605] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:31 2022] DELETE /identity/v3/projects/7b5d891ab7b541619706cccd2980bac9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:32.002716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.004192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:32.018341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec9ca-a7d2-47c4-bbae-0682816c9014 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.068095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:32.082219 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.083251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.083635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.083819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] PATH_INFO: `/v3/users/2e6924a793d74f82834bd4089203ebe9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.084999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6924a793d74f82834bd4089203ebe9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:32.087004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:32.136037 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6924a793d74f82834bd4089203ebe9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.148310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6924a793d74f82834bd4089203ebe9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.149049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6924a793d74f82834bd4089203ebe9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.157223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6924a793d74f82834bd4089203ebe9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.157968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c61f5511-bc9e-4ded-ae36-c3df65f8ea2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6924a793d74f82834bd4089203ebe9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.170609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1325/2606] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:32 2022] DELETE /identity/v3/users/2e6924a793d74f82834bd4089203ebe9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:32.472651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.474185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:32.495205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309116-fb2b-46d7-9419-ca039b05cd91 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.515138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:32.558604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.559242 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.559520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.559789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] PATH_INFO: `/v3/projects/ee62cb7f788642b6a923f024020327b0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.560933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee62cb7f788642b6a923f024020327b0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:32.562871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:32.609577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee62cb7f788642b6a923f024020327b0', 'request_id': 'req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.615627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee62cb7f788642b6a923f024020327b0', 'request_id': 'req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.622013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee62cb7f788642b6a923f024020327b0', 'request_id': 'req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.635359 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] The token cache is being invalidate because project ee62cb7f788642b6a923f024020327b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:32.635634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.636455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a6bea69d-f36b-49c3-98e7-8f0783fdc8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:32.638342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1282/2607] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:32 2022] DELETE /identity/v3/projects/ee62cb7f788642b6a923f024020327b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:32.643309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.643600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.643872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.663000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:32.664206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:32.730132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1326/2608] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:32.737823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447cf6-84be-4221-b280-645e4508b161 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.738340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447cf6-84be-4221-b280-645e4508b161 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.738537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447cf6-84be-4221-b280-645e4508b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.758395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-31447cf6-84be-4221-b280-645e4508b161 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:32.760098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-31447cf6-84be-4221-b280-645e4508b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:32.768387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1283/2609] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:32.772734 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.783192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1c46-5171-46f4-9bd0-9459c765a275 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.788371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.789246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.789463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.789763 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.790517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:32.790924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:32.792712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:32.806343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1327/2610] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:32.812487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447cf6-84be-4221-b280-645e4508b161 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.822601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447cf6-84be-4221-b280-645e4508b161 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.829048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.829653 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.829929 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.830198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.830842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:32.832849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:32.862221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1284/2611] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:32 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:32.866308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.876778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76830a-8a19-4012-92b7-ede24cf0cc15 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.932387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:32.946802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.947481 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.947894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.948179 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.948890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:32.950982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:32.974680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1328/2612] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:32 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:32.979702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:32.992091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6447e-daaf-48dc-b312-407e5e15bc7c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:32.997837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:32.998476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:32.998753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:32.999024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:32.999680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:33.001348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:33.017886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1285/2613] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:33.019578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:33.032149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c8bb-b070-40b5-88f5-75552f984afa admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:33.037314 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:33.037962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:33.038242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:33.038516 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:33.039199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:33.041040 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697058-b3a5-4fdf-8c5d-2b727bc1a567 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:33.054562 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1329/2614] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:35:33.059462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:33.071736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a30b8-6b5d-4ff0-8e38-d8ebb95de581 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:33.077097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:33.077770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:33.078049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:33.078322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] PATH_INFO: `/v3/projects/b944f487961643e1ac88cbd7b9abc081/users/78223ddc6fc04ed79a223467ef8eec41/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:33.094639 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b944f487961643e1ac88cbd7b9abc081, user_id=78223ddc6fc04ed79a223467ef8eec41, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:33.097337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:33.111975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1286/2615] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:33 2022] PUT /identity/v3/projects/b944f487961643e1ac88cbd7b9abc081/users/78223ddc6fc04ed79a223467ef8eec41/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:33.180001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:33.180201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:33.180458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:33.216586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] MFA Rules not processed for user `78223ddc6fc04ed79a223467ef8eec41`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:33.218060 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:33.293750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1330/2616] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:33.304964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:33.306858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:33.369502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:33.379167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70b7f-3fce-43af-aa4e-c354e278df0d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:33.385504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:33.386255 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:33.386656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:33.387025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:33.402875 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:33.404401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:33.414254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1287/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:33.432174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:33.433689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:33.534963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0a534-021a-4194-b70f-35a0a0a7a3b9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:33.543225 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:33.544118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:33.544405 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:33.544782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:33.546647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:33.565759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:33.567862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e982cd-cfba-403e-96b8-24814c07439a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:33.583784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1331/2618] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:36.038282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.103927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c72e-479d-4692-a3e2-76aaf22bb2ce service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:36.108693 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:36.109414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.109692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.110413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] PATH_INFO: `/v3/users/78223ddc6fc04ed79a223467ef8eec41` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.111046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78223ddc6fc04ed79a223467ef8eec41)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:36.112976 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:36.158317 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78223ddc6fc04ed79a223467ef8eec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.158965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78223ddc6fc04ed79a223467ef8eec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.159569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78223ddc6fc04ed79a223467ef8eec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.166901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78223ddc6fc04ed79a223467ef8eec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.178895 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78223ddc6fc04ed79a223467ef8eec41'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.198065 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1288/2619] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:36 2022] DELETE /identity/v3/users/78223ddc6fc04ed79a223467ef8eec41 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:36.202495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.203003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.203175 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.222007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:36.223182 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:36.266617 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:36.283367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1332/2620] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:36.292905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.294300 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:36.349909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8faa6a-f172-4cd7-bf2a-acbd387fdc48 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:36.353559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:36.354423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.354705 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.354980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.363784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:36.365244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bfec8-20a7-45b6-9eb1-3bcc35b9ca40 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:36.374896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1289/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:36.638616 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.640104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:36.653407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac826b-a86c-4143-b02d-cbd9b1ac6820 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:36.660932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:36.661491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.661774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.662128 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] PATH_INFO: `/v3/projects/b944f487961643e1ac88cbd7b9abc081` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.663199 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b944f487961643e1ac88cbd7b9abc081)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:36.665195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:36.712113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b944f487961643e1ac88cbd7b9abc081', 'request_id': 'req-5c2cda4b-d848-4063-b1c9-71c8b4982f79'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.717668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b944f487961643e1ac88cbd7b9abc081', 'request_id': 'req-5c2cda4b-d848-4063-b1c9-71c8b4982f79'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.724819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b944f487961643e1ac88cbd7b9abc081', 'request_id': 'req-5c2cda4b-d848-4063-b1c9-71c8b4982f79'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.736259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] The token cache is being invalidate because project b944f487961643e1ac88cbd7b9abc081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:36.736550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.737203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5c2cda4b-d848-4063-b1c9-71c8b4982f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:36.738657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1333/2622] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:36 2022] DELETE /identity/v3/projects/b944f487961643e1ac88cbd7b9abc081 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:36.745284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.745578 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.745858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.767916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:36.769174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:36.774524 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:36.831859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1290/2623] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:36.839972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.840262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.840543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.860843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:36.862014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:36.870542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1334/2624] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:36.874594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.883837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82407f9-170a-4ded-a3e8-ea69b989f2ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:36.888304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:36.888931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.889205 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.889472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.890116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:36.890395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:36.891963 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:36.903598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1291/2625] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:36.908132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.918004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c5ef3-0c90-4ec4-9665-ec02388a0c04 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:36.922600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:36.923299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:36.923586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:36.923857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:36.924494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:36.926421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:36.955642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1335/2626] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:36 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:36.956806 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:36.967168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a2dc1-6405-4072-ba30-e1e569b602d2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:37.032665 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:37.033281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.033657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.033837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.034434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:37.036325 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:37.058170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1292/2627] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:36 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:37.062301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:37.073330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0584-fd94-4652-81ff-ae2ebfac23f4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:37.077976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:37.078573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.078861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.079142 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.079782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:37.081610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:37.094054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1336/2628] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:37.098164 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:37.111387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f196-f49c-4b77-8a30-cf91e72e9c1e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:37.116441 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:37.117167 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.117508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.117851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.118597 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:37.120860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a037e-0888-4717-ab22-822dd77bc047 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:37.132770 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1293/2629] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:37.137214 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:37.147620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa123899-6c5b-4c2e-974b-09667817ad44 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:37.152687 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:37.153345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.153646 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.153927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] PATH_INFO: `/v3/projects/fe9d613a7ee84909aa63baf95324130a/users/79ee2ce624074c31bd3f83ecb3f46153/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.173513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9d613a7ee84909aa63baf95324130a, user_id=79ee2ce624074c31bd3f83ecb3f46153, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:37.176246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:37.193311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1337/2630] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:37 2022] PUT /identity/v3/projects/fe9d613a7ee84909aa63baf95324130a/users/79ee2ce624074c31bd3f83ecb3f46153/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:37.198443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.198940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.199327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.218667 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:37.220123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:37.280488 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1294/2631] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:37.290981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:37.293123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:37.349698 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd57e-20a0-42e2-8abd-51c06222a850 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:37.353298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:37.353894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:37.354440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:37.354716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:37.363606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:37.365058 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43702c-a79c-4f91-90b2-3fe4acdd9785 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:37.374883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1338/2632] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:35:38.285392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:38.297360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af2f5-567e-4972-a52a-4f11da478d98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:38.301564 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:38.302463 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:38.302927 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:38.303600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:38.306958 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:38.320235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:38.322215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:38.334727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1295/2633] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:41.897885 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:41.898401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:41.898401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:41.969410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:41.998561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] MFA Rules not processed for user `79ee2ce624074c31bd3f83ecb3f46153`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:41.999813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.144654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1339/2634] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:42.149072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.165459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:42.170748 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678ba6-d3e3-4755-a026-3fa4d1f73276 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.188391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.189974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.190454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.190923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.191569 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.193522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.240652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1296/2635] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:42 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:42.244898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.260284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250fe95-d9b8-41e4-b608-0cf0b79fb6d1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.288818 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.291314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.372293 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.372953 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.373240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.373517 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.374272 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.381691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.425894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1340/2636] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:42 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:42.427351 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.450232 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace727-57bf-4236-beb5-44736803d0cc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.462155 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486a13-1cde-4bea-a926-ad43c8712795 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.462333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.463485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.463768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.465613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.466181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.467662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.472007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.476106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.476106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.476106 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.479652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.493124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.494823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.501999 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1341/2637] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:42.503241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.507031 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.511718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1297/2638] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:42.512857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.523823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd2af-92ac-4023-be2f-6ddd546adbf9 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.531028 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.531804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.543487 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9f065-ecae-4029-a299-be5a61ca1ee7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.544791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.545254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] PATH_INFO: `/v3/projects/8d2373d7635e41dba9e2177a7dba3465/users/64852d97f45741f98f9563dda9dbb96d/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.549815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.550702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.551285 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.551626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] PATH_INFO: `/v3/users/f534b7b5831d4dfc9da5641553c9f635` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.553046 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f534b7b5831d4dfc9da5641553c9f635)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.555021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.567294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2373d7635e41dba9e2177a7dba3465, user_id=64852d97f45741f98f9563dda9dbb96d, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.570121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.586466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1298/2639] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:42 2022] PUT /identity/v3/projects/8d2373d7635e41dba9e2177a7dba3465/users/64852d97f45741f98f9563dda9dbb96d/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:42.591624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.627127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f534b7b5831d4dfc9da5641553c9f635'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:42.647125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f534b7b5831d4dfc9da5641553c9f635'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:42.647907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f534b7b5831d4dfc9da5641553c9f635'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:42.655850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f534b7b5831d4dfc9da5641553c9f635'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:42.656519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f534b7b5831d4dfc9da5641553c9f635'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:42.658680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:42.672927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1342/2640] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:42 2022] DELETE /identity/v3/users/f534b7b5831d4dfc9da5641553c9f635 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:42.674673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56f95e-220c-4999-b093-e4c22dc5d818 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.735159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:42.750522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.751161 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.751447 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.751723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.752377 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.754022 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.766528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1299/2641] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:35:42.770520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.772002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.788120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3cbf-ebc8-408c-a9be-eb8bb419f67a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:42.795706 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:42.796393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:42.796714 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:42.796994 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] PATH_INFO: `/v3/projects/8d2373d7635e41dba9e2177a7dba3465/users/64852d97f45741f98f9563dda9dbb96d/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:42.799117 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2373d7635e41dba9e2177a7dba3465, user_id=64852d97f45741f98f9563dda9dbb96d, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:42.802204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b945fa-d939-4a2e-8a9b-4417a386b46f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:42.815677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1343/2642] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:42 2022] PUT /identity/v3/projects/8d2373d7635e41dba9e2177a7dba3465/users/64852d97f45741f98f9563dda9dbb96d/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:42.901418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:42.905150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:42.937468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f69f-079d-4a63-b230-de07cf77521e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.022143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.022516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.023006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.023372 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] PATH_INFO: `/v3/projects/3089bccb17e0401ebc27a3cbbc752b02` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.026041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3089bccb17e0401ebc27a3cbbc752b02)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.028369 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.090745 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3089bccb17e0401ebc27a3cbbc752b02', 'request_id': 'req-321a9e8b-acca-41dd-922a-796e80765b82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:43.098827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3089bccb17e0401ebc27a3cbbc752b02', 'request_id': 'req-321a9e8b-acca-41dd-922a-796e80765b82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:43.105680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3089bccb17e0401ebc27a3cbbc752b02', 'request_id': 'req-321a9e8b-acca-41dd-922a-796e80765b82'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:43.121459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] The token cache is being invalidate because project 3089bccb17e0401ebc27a3cbbc752b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:43.121785 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:43.122454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-321a9e8b-acca-41dd-922a-796e80765b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:43.123983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1300/2643] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:42 2022] DELETE /identity/v3/projects/3089bccb17e0401ebc27a3cbbc752b02 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:43.129116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.129615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.129818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.154652 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:43.157165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:43.249934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1344/2644] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:43.260041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.260608 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.263295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.285772 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:43.286980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:43.295552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1301/2645] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:43.299497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.312449 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b45e-7c59-4937-951c-e193d4bc4c77 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.317547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.318178 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.318460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.318741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.319542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:43.319674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.321482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.338590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1345/2646] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:35:43.339819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.349528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a791-6395-4ebc-b199-0b944dadf6ad None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.355034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.355816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.356299 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.356814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.357536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.359559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.392600 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1302/2647] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:43 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:43.396643 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.408692 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9911f-26f7-49d3-b9d6-224eb70f2eaf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.481413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.482183 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.482526 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.482879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.483581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.486052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.533888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.542722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1346/2648] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:43 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:43.547873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd38c4-49f5-443a-be8e-2835ab18b0c2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.554185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.555301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.555769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.556468 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.557394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.559584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.576752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.583208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1303/2649] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:43.590086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8217b-0340-4fd6-a69d-1a23fec2ffb3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.596484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.597861 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.598497 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.598955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.599837 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.601659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ec05-e0db-4e03-b51b-8e74e1760610 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.619888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.620857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1347/2650] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:35:43.636024 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190f5cb-5540-4fe3-abaa-cdfe1c93a0d5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.641238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.641916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.642194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.642481 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] PATH_INFO: `/v3/projects/0d413ae20232452bae8785d399f9aa66/users/42e6d19499aa47fca1864ba667821b9c/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.661303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d413ae20232452bae8785d399f9aa66, user_id=42e6d19499aa47fca1864ba667821b9c, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.664589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:43.684767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1304/2651] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:43 2022] PUT /identity/v3/projects/0d413ae20232452bae8785d399f9aa66/users/42e6d19499aa47fca1864ba667821b9c/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:43.695350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.695768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.696141 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.730883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] MFA Rules not processed for user `42e6d19499aa47fca1864ba667821b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:43.732605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:43.773463 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:43.817827 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1348/2652] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:43.829587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:43.831677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:43.867500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:43.965586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d70-5a6c-4e78-9420-e4b4e3fc8944 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:43.976496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:43.978127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:43.978483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:43.978820 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:43.989558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:43.991870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e4fa-fab6-41a6-87b0-dba40b33ef56 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:44.017483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1305/2653] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:47.135672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:47.210338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f69fc1-623b-45b2-9267-1eb088db4aff None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:47.216749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:47.217920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.218216 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.218491 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] PATH_INFO: `/v3/users/42e6d19499aa47fca1864ba667821b9c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.225414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e6d19499aa47fca1864ba667821b9c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:47.227605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:47.300627 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e6d19499aa47fca1864ba667821b9c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:47.318983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e6d19499aa47fca1864ba667821b9c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:47.320155 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e6d19499aa47fca1864ba667821b9c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:47.330432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e6d19499aa47fca1864ba667821b9c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:47.331522 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e6d19499aa47fca1864ba667821b9c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:47.350361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1349/2654] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:47 2022] DELETE /identity/v3/users/42e6d19499aa47fca1864ba667821b9c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:47.355863 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e8b8-4af2-4496-9706-8f0cea1ebaa2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.356395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e8b8-4af2-4496-9706-8f0cea1ebaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.356493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e8b8-4af2-4496-9706-8f0cea1ebaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.377613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5fc2e8b8-4af2-4496-9706-8f0cea1ebaa2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:47.379097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5fc2e8b8-4af2-4496-9706-8f0cea1ebaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.466146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1306/2655] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:47.479009 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:47.481007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.561647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.561937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.562211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.572907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321837-7a5e-49b8-bb09-5ef198414195 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:47.585153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:47.586469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.586845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.587276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.592592 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] MFA Rules not processed for user `64852d97f45741f98f9563dda9dbb96d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:47.593910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.596956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:47.603043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:47.606498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:47.622086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1350/2656] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:47.678755 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1307/2657] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:47.693165 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:47.695425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.767889 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b8eb5-88c8-47cd-8d99-5a018640c65e service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:47.771980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:47.772710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.773464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.773464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.775494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.849518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:47.850951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e602f6-95f3-47d4-b02c-4a5e5b5036f7 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:47.862080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1351/2658] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:47.950776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:47.952244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:47.968219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755cc25-473e-4404-969a-4051d67669d1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:47.983829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:47.984525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:47.988156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:47.988899 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] PATH_INFO: `/v3/projects/0d413ae20232452bae8785d399f9aa66` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:47.990251 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d413ae20232452bae8785d399f9aa66)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:47.998284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.029180 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:48.038493 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.038931 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.039276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.059352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d413ae20232452bae8785d399f9aa66', 'request_id': 'req-9a2a2aec-de17-4478-b3c2-912e680c6edc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:48.066921 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:48.067832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d413ae20232452bae8785d399f9aa66', 'request_id': 'req-9a2a2aec-de17-4478-b3c2-912e680c6edc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:48.068172 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:48.076163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d413ae20232452bae8785d399f9aa66', 'request_id': 'req-9a2a2aec-de17-4478-b3c2-912e680c6edc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:48.094650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] The token cache is being invalidate because project 0d413ae20232452bae8785d399f9aa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:48.094959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:48.096218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9a2a2aec-de17-4478-b3c2-912e680c6edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:48.098719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1308/2659] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:47 2022] DELETE /identity/v3/projects/0d413ae20232452bae8785d399f9aa66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:48.105001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a3725-44dd-4552-9bc7-b6ada5e31f0e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.105485 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a3725-44dd-4552-9bc7-b6ada5e31f0e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.106042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a3725-44dd-4552-9bc7-b6ada5e31f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.130893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1352/2660] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:48.132773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b51a3725-44dd-4552-9bc7-b6ada5e31f0e None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:48.134132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b51a3725-44dd-4552-9bc7-b6ada5e31f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:48.156007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.157582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:48.206001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1309/2661] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:48.214450 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.214732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.215409 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.229484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:48.236638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:48.237825 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:48.246615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1310/2662] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:48.247248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964641d-b5da-4e9c-adb7-5f34dec595c9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.250736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.252937 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.253563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.253850 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.254125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.262761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3e07f-9ea1-4791-a2bf-206f46d73444 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.264813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.266406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.269057 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.269750 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.270309 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.270775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.272129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:48.272506 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.274454 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.276192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1353/2663] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 06:35:48.287917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1311/2664] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:35:48.292506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.304240 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16823d6c-5d11-40d5-a395-1097b21be2be service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.310746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.310978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.311970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.311970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.313429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.318104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.370712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1354/2665] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:48.372207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.397950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c235c8-01d6-4f49-9067-4acda9fc8f86 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.506674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.507391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.507674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.507946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.510974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.522047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.559237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1312/2666] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:48.571177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.583021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22fa25-2e93-4c13-931e-4df0a9c19e4d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.587928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.588582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.589027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.589310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.589965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.591569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.611628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1355/2667] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:48.615845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.641692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce7523-296b-4ac8-b698-b6d87bc99385 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.648349 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.649126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.649413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.650132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.650888 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.652620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f1fb5-804f-49c4-99c2-be53a5ae4257 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.667858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1313/2668] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:48.673374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.688804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35759-8b10-4283-9ee3-3ecdac8773bd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.696521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.703755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.704101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.704477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] PATH_INFO: `/v3/projects/cd2789ad5cf44caa9983f5fbe8c50ea6/users/87b1781869c84052968bbe903ef0ed4f/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.724888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2789ad5cf44caa9983f5fbe8c50ea6, user_id=87b1781869c84052968bbe903ef0ed4f, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:48.727951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:48.761073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1356/2669] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:48 2022] PUT /identity/v3/projects/cd2789ad5cf44caa9983f5fbe8c50ea6/users/87b1781869c84052968bbe903ef0ed4f/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:48.774716 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.775283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.775599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.801461 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:48.813194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] MFA Rules not processed for user `87b1781869c84052968bbe903ef0ed4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:48.813915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:48.908536 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1314/2670] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:48.916256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:48.989955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cce86-4f13-411d-81f3-006065f60e02 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:48.995193 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:48.996842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:48.997290 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:48.997575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:48.998237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.000242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.037048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1357/2671] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:48 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:49.038682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.054480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eb472-ae8c-4673-9e99-65c7ff51e0ae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.131305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.132413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.133042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.133497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.134347 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.137059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.171707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.172624 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1315/2672] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:49 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:49.192439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58175aec-28c0-484e-8159-a11a1f000547 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.197842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.198572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.198951 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.199322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.200066 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.202036 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.220961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1358/2673] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:35:49.222839 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.236952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171be8d-f5b0-4f99-aeb0-f86d9d450cca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.242535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.243232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.244140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.244420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] PATH_INFO: `/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b/users/6879877ff6834cec9f9184cd5f374ded/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.271146 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b2ccf6e2384cdbb6879c18c637f98b, user_id=6879877ff6834cec9f9184cd5f374ded, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.276416 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.293565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1316/2674] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:49 2022] PUT /identity/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b/users/6879877ff6834cec9f9184cd5f374ded/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:49.297482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.313929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452e715-1ed3-4d52-af4a-e12f240264be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.386518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.387409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.387684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.388129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.388911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.390512 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594045ff-c48e-43e6-b879-1b7d8cf1475a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.393359 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:49.408083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1359/2675] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:49.409374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.426709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e41250-232b-43c3-a816-e79bbbc36389 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.431790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.432582 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.433041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.433540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] PATH_INFO: `/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b/users/6879877ff6834cec9f9184cd5f374ded/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.438304 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b2ccf6e2384cdbb6879c18c637f98b, user_id=6879877ff6834cec9f9184cd5f374ded, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.441195 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.456472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1317/2676] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:49 2022] PUT /identity/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b/users/6879877ff6834cec9f9184cd5f374ded/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:49.467261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.467555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.467840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.503211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] MFA Rules not processed for user `6879877ff6834cec9f9184cd5f374ded`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:49.504972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:49.588012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1360/2677] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:49.599777 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:49.601685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:49.666831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa68bf-ad01-4780-ab54-18e1d2221b15 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:49.673735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:49.674499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:49.674867 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:49.675148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:49.683132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:49.687051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:49.689465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9799c-a059-4944-9a0e-23c0af7ae74c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:49.705229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1318/2678] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:50.214192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:50.317370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc45d9-1a46-4142-8b9c-d627827814bf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:50.322528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:50.323335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:50.323626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:50.323906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] PATH_INFO: `/v3/users/87b1781869c84052968bbe903ef0ed4f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:50.325072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b1781869c84052968bbe903ef0ed4f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:50.327118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:50.444867 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b1781869c84052968bbe903ef0ed4f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:50.465647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b1781869c84052968bbe903ef0ed4f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:50.466455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b1781869c84052968bbe903ef0ed4f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:50.478849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b1781869c84052968bbe903ef0ed4f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:50.479976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b1781869c84052968bbe903ef0ed4f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:50.525544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1361/2679] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:50 2022] DELETE /identity/v3/users/87b1781869c84052968bbe903ef0ed4f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:50.528077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:50.529079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:50.529504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:50.574913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:50.577753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:50.675148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1319/2680] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:50.688211 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:50.689997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:50.701307 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:50.817866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985408-0197-453d-b924-93d4382c0d2e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:50.824488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:50.825393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:50.825677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:50.826002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:50.838166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:50.839658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:50.865476 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1362/2681] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:51.251046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:51.253482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:51.296489 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987851c9-54a7-4e32-bb2f-743c64ce0b83 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:51.323742 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:51.324530 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:51.324838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:51.325112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] PATH_INFO: `/v3/projects/cd2789ad5cf44caa9983f5fbe8c50ea6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:51.330379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2789ad5cf44caa9983f5fbe8c50ea6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:51.332598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:51.421439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2789ad5cf44caa9983f5fbe8c50ea6', 'request_id': 'req-c27696be-3378-48b9-9f97-d595762009aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.430776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2789ad5cf44caa9983f5fbe8c50ea6', 'request_id': 'req-c27696be-3378-48b9-9f97-d595762009aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.437509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2789ad5cf44caa9983f5fbe8c50ea6', 'request_id': 'req-c27696be-3378-48b9-9f97-d595762009aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.454798 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] The token cache is being invalidate because project cd2789ad5cf44caa9983f5fbe8c50ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:51.455100 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.455838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.457438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1320/2682] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:51 2022] DELETE /identity/v3/projects/cd2789ad5cf44caa9983f5fbe8c50ea6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:51.461393 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:51.473357 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d6c6-aab4-452b-bd1e-b09c35ff9b2d service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:51.554389 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:51.555302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:51.556893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:51.557346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] PATH_INFO: `/v3/users/6879877ff6834cec9f9184cd5f374ded` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:51.561838 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6879877ff6834cec9f9184cd5f374ded)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:51.564421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:51.639230 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6879877ff6834cec9f9184cd5f374ded'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.657663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6879877ff6834cec9f9184cd5f374ded'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.658451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6879877ff6834cec9f9184cd5f374ded'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.673880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6879877ff6834cec9f9184cd5f374ded'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.674638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-20cfc5bc-00b3-4413-bf09-f330a91e332d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6879877ff6834cec9f9184cd5f374ded'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:51.699098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1363/2683] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:35:51 2022] DELETE /identity/v3/users/6879877ff6834cec9f9184cd5f374ded => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:52.062586 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.064058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:52.079954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27696be-3378-48b9-9f97-d595762009aa admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.206766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.207429 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.207712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.207987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] PATH_INFO: `/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.209341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b2ccf6e2384cdbb6879c18c637f98b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.211292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.255855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:52.297217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b2ccf6e2384cdbb6879c18c637f98b', 'request_id': 'req-3817c046-9eef-4e22-a651-3ca92006999d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:52.304142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b2ccf6e2384cdbb6879c18c637f98b', 'request_id': 'req-3817c046-9eef-4e22-a651-3ca92006999d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:52.310790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b2ccf6e2384cdbb6879c18c637f98b', 'request_id': 'req-3817c046-9eef-4e22-a651-3ca92006999d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:52.326417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] The token cache is being invalidate because project 13b2ccf6e2384cdbb6879c18c637f98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:35:52.326779 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:52.327339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3817c046-9eef-4e22-a651-3ca92006999d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:35:52.329358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1321/2684] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:35:52 2022] DELETE /identity/v3/projects/13b2ccf6e2384cdbb6879c18c637f98b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:52.334192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.334361 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.335395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.361371 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:52.365202 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:52.413537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:52.509412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1364/2685] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:52.517109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.518162 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.518615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.556662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:52.557831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:52.568771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1322/2686] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:52.573028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.583415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7587e-14b1-4fba-a515-2d797f0b5a5d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.589204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.589828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.592363 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.592747 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.593416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:35:52.593793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.595482 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.614824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.620916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1365/2687] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:35:52.627185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87aff3-d463-4c56-8585-b77433a245f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.637439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.638076 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.638365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.638644 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.639351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.641305 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.687661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1323/2688] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:52 2022] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:52.688509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.702820 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918630-e2fc-4761-aa17-079be85cd1bd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.783485 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.784152 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.784466 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.784884 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.785378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.787451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.816379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1366/2689] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:52 2022] POST /identity/v3/users => generated 278 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:35:52.817776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.830340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fd159-c3a9-4ad9-97d4-5c403dca5d08 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.835840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.836457 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.836778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.837715 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.838355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.840014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.859648 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1324/2690] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:52.860900 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.871705 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797f74-acba-4b2b-af23-7463ba79d760 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.879135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.880024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.880755 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.881201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.882016 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.884301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc18b9-a4bd-4d40-b443-ba185cf434f1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.896311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1367/2691] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:52.901280 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:52.919124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f61d5-cf4e-4ab4-b4af-101f00901faf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:52.928786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:52.929511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.929796 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.930469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] PATH_INFO: `/v3/projects/4559f0417a484fa5bec38ac370ccab0e/users/9d2b6f24e9cb497c880c07d6fd4e7091/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:52.947554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4559f0417a484fa5bec38ac370ccab0e, user_id=9d2b6f24e9cb497c880c07d6fd4e7091, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:52.951177 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:52.977961 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1325/2692] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:52 2022] PUT /identity/v3/projects/4559f0417a484fa5bec38ac370ccab0e/users/9d2b6f24e9cb497c880c07d6fd4e7091/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:35:52.981093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:52.981391 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:52.981674 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.013569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] MFA Rules not processed for user `9d2b6f24e9cb497c880c07d6fd4e7091`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:53.015212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:53.084657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1368/2693] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:53.091399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.161516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9156a-ab5a-4da0-857d-02e8ec0d58cf admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.166666 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.167407 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.167760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.168236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.169020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.170986 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.207712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1326/2694] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:35:53 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:53.211750 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.224145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bebac-b5ec-456d-ac1d-28c5b2c49425 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.246072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:53.294112 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.295125 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.295413 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.295685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.296329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.300860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.332701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1369/2695] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:35:53 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:35:53.336387 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.350424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f98f9-ff40-45f3-b093-968e89d67214 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.355552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.356271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.356677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.357045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.357759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.361845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.373827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1327/2696] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:35:53.377932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.390048 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed33f-3c04-4423-b5ae-479802c2b2bd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.400376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.400927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.401208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.401574 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] PATH_INFO: `/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57/users/3bb64d0512944582a49fae4c1cf6bde7/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.422104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9fecaf78864e2e8c3d7b83f9d5aa57, user_id=3bb64d0512944582a49fae4c1cf6bde7, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.426865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.442014 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1370/2697] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:53 2022] PUT /identity/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57/users/3bb64d0512944582a49fae4c1cf6bde7/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:53.446353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.457560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77873489-07ed-4e65-9ca0-54901f9c4be3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.477334 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:53.534841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.535470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.535783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.536058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.536751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.538599 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38640d6f-29e0-4284-a411-03b098540422 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.550833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1328/2698] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:35:53.554552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.568001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093661-ee3f-4ef5-bee8-28a820e86560 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.573263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.574086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.574429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.574769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] PATH_INFO: `/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57/users/3bb64d0512944582a49fae4c1cf6bde7/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.577231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9fecaf78864e2e8c3d7b83f9d5aa57, user_id=3bb64d0512944582a49fae4c1cf6bde7, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.579636 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.591519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1371/2699] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:35:53 2022] PUT /identity/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57/users/3bb64d0512944582a49fae4c1cf6bde7/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:35:53.602034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.603109 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.603558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.639140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] MFA Rules not processed for user `3bb64d0512944582a49fae4c1cf6bde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:53.640842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:53.719776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1329/2700] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:35:53.732899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.735049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:53.804256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777edf-3a1e-4a38-928b-a3691d2d166c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.808051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.808689 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.808972 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.809244 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:53.819161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:53.820922 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8b8b9-e86d-4fa2-ae12-124b34ecbb57 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:53.831311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1372/2701] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:53.920443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:53.933932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff60c-b4b9-4d04-9ddc-6f24aea855bc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:53.938128 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:53.938998 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:53.939341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:53.939691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:54.007025 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:54.008925 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:54.018604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1330/2702] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:35:58.289561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae5d96-ccea-4e01-9bad-9b0ce2afe057 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:58.290716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae5d96-ccea-4e01-9bad-9b0ce2afe057 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:58.290716 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae5d96-ccea-4e01-9bad-9b0ce2afe057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:58.309971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-73ae5d96-ccea-4e01-9bad-9b0ce2afe057 None None] MFA Rules not processed for user `79ee2ce624074c31bd3f83ecb3f46153`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:35:58.311263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-73ae5d96-ccea-4e01-9bad-9b0ce2afe057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:58.369995 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1373/2703] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:35:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:35:58.646776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:35:58.648173 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:58.692522 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:58.706906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400118-2e45-4e1a-995d-cff2e0a29749 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:35:58.710448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:35:58.711045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:35:58.711324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:35:58.711596 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:35:58.714009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:35:58.723227 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:35:58.724699 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:35:58.732782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1331/2704] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:35:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:00.351490 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:00.351976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:00.352099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:00.372878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:00.374215 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:00.388796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:00.441934 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1374/2705] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:36:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:00.454316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:00.455729 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:00.525437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1aed-eafc-4c49-9033-7136beeb87e0 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:00.530690 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:00.531262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:00.531544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:00.531827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:00.540876 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:00.542471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c4f1b-701f-4144-b70e-309e74ba86f8 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:00.550555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1332/2706] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:36:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:09.654347 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:09.730250 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d1a8-b739-42b9-b070-39fdbcc34b71 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:09.737171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:09.737817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:09.738103 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:09.738378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] PATH_INFO: `/v3/users/9d2b6f24e9cb497c880c07d6fd4e7091` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:09.739697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2b6f24e9cb497c880c07d6fd4e7091)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:09.741739 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:09.794710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2b6f24e9cb497c880c07d6fd4e7091'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:09.809610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2b6f24e9cb497c880c07d6fd4e7091'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:09.811378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2b6f24e9cb497c880c07d6fd4e7091'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:09.820350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2b6f24e9cb497c880c07d6fd4e7091'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:09.822082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2b6f24e9cb497c880c07d6fd4e7091'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:09.844848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1375/2707] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:09 2022] DELETE /identity/v3/users/9d2b6f24e9cb497c880c07d6fd4e7091 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:09.849346 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:09.849916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:09.850036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:09.882448 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:09.884830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:09.960944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1333/2708] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:09.967828 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:09.969315 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:10.020904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:10.036378 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d60e6-ffe4-4083-96b2-0d83a9f79f3c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:10.041688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:10.042368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:10.042708 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:10.042986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:10.057423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:10.058894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:10.069580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1376/2709] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:10.347521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:10.349160 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:10.361923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95e90-094f-4a98-8072-4f6c0c116c62 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:10.366514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:10.368353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:10.368886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:10.369555 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] PATH_INFO: `/v3/projects/4559f0417a484fa5bec38ac370ccab0e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:10.370724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4559f0417a484fa5bec38ac370ccab0e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:10.372646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:10.420973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4559f0417a484fa5bec38ac370ccab0e', 'request_id': 'req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.427269 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4559f0417a484fa5bec38ac370ccab0e', 'request_id': 'req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.433319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4559f0417a484fa5bec38ac370ccab0e', 'request_id': 'req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.436858 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:10.447795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] The token cache is being invalidate because project 4559f0417a484fa5bec38ac370ccab0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:10.448352 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.449235 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.450724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1334/2710] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:10 2022] DELETE /identity/v3/projects/4559f0417a484fa5bec38ac370ccab0e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:10.454690 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:10.464136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba4fa-ccc0-4c0f-a77a-4f040c3e6eb8 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:10.519531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:10.520154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:10.520437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:10.520767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] PATH_INFO: `/v3/users/3bb64d0512944582a49fae4c1cf6bde7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:10.521873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb64d0512944582a49fae4c1cf6bde7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:10.523772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:10.568075 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb64d0512944582a49fae4c1cf6bde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.580331 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb64d0512944582a49fae4c1cf6bde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.581021 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb64d0512944582a49fae4c1cf6bde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.587818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb64d0512944582a49fae4c1cf6bde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.588447 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-94b528ce-f4bb-4e32-abe9-2b5343ee9624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb64d0512944582a49fae4c1cf6bde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:10.600998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1377/2711] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:10 2022] DELETE /identity/v3/users/3bb64d0512944582a49fae4c1cf6bde7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:10.930833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:10.933240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:10.949437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7deab-9bc1-4811-a1cd-2bdaa1196bf8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.015995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.016778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.017124 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.017410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] PATH_INFO: `/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.018550 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9fecaf78864e2e8c3d7b83f9d5aa57)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.020688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.076059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9fecaf78864e2e8c3d7b83f9d5aa57', 'request_id': 'req-f97cbc15-2dc0-4276-95d0-a7c427991e94'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:11.084421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9fecaf78864e2e8c3d7b83f9d5aa57', 'request_id': 'req-f97cbc15-2dc0-4276-95d0-a7c427991e94'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:11.092079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9fecaf78864e2e8c3d7b83f9d5aa57', 'request_id': 'req-f97cbc15-2dc0-4276-95d0-a7c427991e94'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:11.124804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] The token cache is being invalidate because project 1d9fecaf78864e2e8c3d7b83f9d5aa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:11.125092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:11.125782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f97cbc15-2dc0-4276-95d0-a7c427991e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:11.127568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1335/2712] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:10 2022] DELETE /identity/v3/projects/1d9fecaf78864e2e8c3d7b83f9d5aa57 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:11.132955 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.133555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.133555 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.154659 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:11.155873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:11.221729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1378/2713] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:11.231758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.232046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.232319 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.252791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:11.253982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:11.261985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1336/2714] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:11.266180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.277069 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d931-7d69-488e-ae68-44d42bf96bf8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.281891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.282495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.282785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.283156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.283733 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:36:11.283978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.285641 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.287198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:11.304471 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1379/2715] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:36:11.305293 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.314669 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba098159-4339-4cb8-8ac4-5002c2981ffe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.319339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.319934 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.320209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.320476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.321200 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.323074 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.356743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1337/2716] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:11.357929 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.371107 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deabb7-070a-4a4a-bb32-28ed2263faff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.429480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.430088 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.430364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.430635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.431259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.433186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.458450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1380/2717] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:11.459865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.470603 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35f33-cfeb-4092-8a62-424f1a14ff1c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.475193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.475791 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.476072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.476343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.477011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.478587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.489881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1338/2718] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:36:11.494006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.504039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178495f-c4c3-485f-8a54-9fd646846cfb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.509596 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.510284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.510591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.511665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.512311 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.513958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafd033-b691-4717-a56a-c9802487e419 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.525409 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1381/2719] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:36:11.529646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.540016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e3c45-cddd-452b-ab7a-8aec0977be18 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.545126 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.545780 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.546059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.546332 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] PATH_INFO: `/v3/projects/0886c2f474cf4ef7b9ecc102046af8ae/users/0102d83a75ef49b7aeb952547d416168/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.561688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0886c2f474cf4ef7b9ecc102046af8ae, user_id=0102d83a75ef49b7aeb952547d416168, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.564496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.578233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1339/2720] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:11 2022] PUT /identity/v3/projects/0886c2f474cf4ef7b9ecc102046af8ae/users/0102d83a75ef49b7aeb952547d416168/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:11.589330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.589618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.589891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.617499 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] MFA Rules not processed for user `0102d83a75ef49b7aeb952547d416168`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:11.618806 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:11.681510 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1382/2721] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:11.685978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.710861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:11.748548 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84d55-67a0-4231-9081-1a0477f97236 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.753221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.753828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.754113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.754391 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.755020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.756947 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.783583 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1340/2722] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:11.787600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.797998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bd9bb-0940-444a-8eaf-346f40f95146 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.853961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.854809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.855093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.855368 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.856001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.857945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.866648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:11.881356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1383/2723] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:11 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:11.885754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.895952 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ce03-7a6b-4a55-888f-87c9a2170851 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.900656 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.901340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.901686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.901966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.902675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.904292 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.914681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1341/2724] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:11.918776 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.928707 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3656ca-1fc9-44fc-ae6a-549b68e43184 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:11.934135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:11.934796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:11.935083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:11.935425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] PATH_INFO: `/v3/projects/4c448b98ac6e4463b9a0afd212e7c442/users/b88e87a8f6e743e7af721fbc75727ae5/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:11.952099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c448b98ac6e4463b9a0afd212e7c442, user_id=b88e87a8f6e743e7af721fbc75727ae5, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:11.954802 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:11.968283 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1384/2725] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:11 2022] PUT /identity/v3/projects/4c448b98ac6e4463b9a0afd212e7c442/users/b88e87a8f6e743e7af721fbc75727ae5/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:11.972396 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:11.982768 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851711-1f40-4110-b4b5-47b926788c20 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:12.040673 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:12.041284 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:12.041558 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:12.041828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:12.042464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:12.044035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5b7d5-6b16-46f0-9b62-04e47c5e0d8e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:12.054007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1342/2726] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:12.058878 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:12.069535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093078d6-2642-42f3-a8d2-f6a5e9c25ec8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:12.075262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:12.075918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:12.076203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:12.076478 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] PATH_INFO: `/v3/projects/4c448b98ac6e4463b9a0afd212e7c442/users/b88e87a8f6e743e7af721fbc75727ae5/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:12.078421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c448b98ac6e4463b9a0afd212e7c442, user_id=b88e87a8f6e743e7af721fbc75727ae5, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:12.082891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:12.094284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1385/2727] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:12 2022] PUT /identity/v3/projects/4c448b98ac6e4463b9a0afd212e7c442/users/b88e87a8f6e743e7af721fbc75727ae5/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:12.105384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:12.105761 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:12.106098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:12.136278 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] MFA Rules not processed for user `b88e87a8f6e743e7af721fbc75727ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:12.137504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:12.207192 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1343/2728] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:12.218377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:12.220191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:12.287662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c61b6-8871-4304-b952-fd68cac4c994 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:12.291887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:12.292494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:12.292805 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:12.293078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:12.302571 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:12.304154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:12.314364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1386/2729] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:12.424084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:12.435034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a029c1-3282-4f3d-88be-3e95b87a9dd5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:12.439038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:12.439741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:12.440088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:12.440735 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:12.455144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:12.501428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:12.502848 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:12.511794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1344/2730] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:14.060728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:14.063370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:14.150754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c085-fa63-4f2a-b503-7e7d4da2174a service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:14.156531 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:14.157954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:14.158242 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:14.158525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:14.160411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:14.173418 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:14.174970 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ff62-408a-495f-b439-cdd94a64e95e service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:14.186338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1387/2731] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:15.099050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:15.161314 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28927-8ab7-4c0b-b064-75fb7e281934 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:15.166337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:15.166967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:15.167248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:15.167521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] PATH_INFO: `/v3/users/0102d83a75ef49b7aeb952547d416168` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:15.168792 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0102d83a75ef49b7aeb952547d416168)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:15.170722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:15.230054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0102d83a75ef49b7aeb952547d416168'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:15.230707 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0102d83a75ef49b7aeb952547d416168'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:15.233144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0102d83a75ef49b7aeb952547d416168'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:15.239078 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0102d83a75ef49b7aeb952547d416168'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:15.252245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0102d83a75ef49b7aeb952547d416168'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:15.266340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1345/2732] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:15 2022] DELETE /identity/v3/users/0102d83a75ef49b7aeb952547d416168 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:15.270849 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:15.271372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:15.271489 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:15.290713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:15.291896 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:15.337710 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:15.361501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:15.363415 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:15.373811 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1388/2733] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:15.383758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:15.386227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:15.421093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:15.471855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b724-1c7c-48be-b898-c2de8fd3d0aa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:15.472084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fde9-53de-4c36-9bb2-e7e1d92a904d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:15.477303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:15.478229 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d7cab58d5cc49469cf0ba0180f19100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:15.478550 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:15.478833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:15.479029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:15.479408 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:15.479589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:15.479954 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:15.485634 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:15.492336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:15.493313 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:15.505841 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1389/2734] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:15.507997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:15.510535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:15.529534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1346/2735] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:36:15.911406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:15.912948 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:15.927534 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6400d0-c69a-4510-941b-a6182f9c2d67 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:15.932173 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:15.932865 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:15.933145 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:15.933424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] PATH_INFO: `/v3/projects/0886c2f474cf4ef7b9ecc102046af8ae` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:15.934683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0886c2f474cf4ef7b9ecc102046af8ae)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:15.936620 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:16.013269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0886c2f474cf4ef7b9ecc102046af8ae', 'request_id': 'req-f7d438c6-3ba4-4bd6-825d-aca719630a86'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.020284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0886c2f474cf4ef7b9ecc102046af8ae', 'request_id': 'req-f7d438c6-3ba4-4bd6-825d-aca719630a86'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.030255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0886c2f474cf4ef7b9ecc102046af8ae', 'request_id': 'req-f7d438c6-3ba4-4bd6-825d-aca719630a86'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.045662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] The token cache is being invalidate because project 0886c2f474cf4ef7b9ecc102046af8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:16.046044 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.047416 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.049006 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1390/2736] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:15 2022] DELETE /identity/v3/projects/0886c2f474cf4ef7b9ecc102046af8ae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:16.053570 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:16.064544 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69db7-cc10-4a23-8292-ad7c31b1e683 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:16.132356 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:16.133553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.133829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.134097 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] PATH_INFO: `/v3/users/b88e87a8f6e743e7af721fbc75727ae5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.135224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88e87a8f6e743e7af721fbc75727ae5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:16.137244 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:16.194424 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88e87a8f6e743e7af721fbc75727ae5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.195330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88e87a8f6e743e7af721fbc75727ae5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.196484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88e87a8f6e743e7af721fbc75727ae5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.204395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88e87a8f6e743e7af721fbc75727ae5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.218851 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2d323479-de21-4752-b51f-ca3bfd5450c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88e87a8f6e743e7af721fbc75727ae5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.233201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1347/2737] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:16 2022] DELETE /identity/v3/users/b88e87a8f6e743e7af721fbc75727ae5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:16.544410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:16.545880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:16.565623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d438c6-3ba4-4bd6-825d-aca719630a86 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:16.626583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:16.627221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.627506 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.627783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] PATH_INFO: `/v3/projects/4c448b98ac6e4463b9a0afd212e7c442` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.628944 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c448b98ac6e4463b9a0afd212e7c442)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:16.630839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:16.642611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:16.685167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c448b98ac6e4463b9a0afd212e7c442', 'request_id': 'req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.690800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c448b98ac6e4463b9a0afd212e7c442', 'request_id': 'req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.698928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c448b98ac6e4463b9a0afd212e7c442', 'request_id': 'req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.711458 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] The token cache is being invalidate because project 4c448b98ac6e4463b9a0afd212e7c442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:16.711662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.712340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b18c944-cd3f-4230-b7c4-f5deb9021d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:16.714220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1391/2738] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:16 2022] DELETE /identity/v3/projects/4c448b98ac6e4463b9a0afd212e7c442 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:16.719257 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.719553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.719832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.740029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:16.741262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:16.778099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:16.808380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1348/2739] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:16.816065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.816891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.817387 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.842816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:16.844166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:16.853728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1392/2740] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:16.858067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:16.868758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017102f-7afa-46b9-90ab-814244e56dde None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:16.874637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:16.875427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.875552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.876219 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.876913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:36:16.877215 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:16.878810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:16.892127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1349/2741] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:36:16.897227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:16.910406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f82d7-df5a-42f1-9687-5b4f19f61f66 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:16.917479 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:16.917715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:16.917882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:16.918119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:16.918775 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:16.921819 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:16.955116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1393/2742] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:16 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:16.959519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:16.971590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d57b-57c5-405a-a129-9cff6796dfc4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.064879 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.065864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.066340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.066774 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.067909 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.070696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.106482 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1350/2743] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:16 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:36:17.110415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.127618 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d89ac2-83db-4559-bf94-b122da6aef92 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.144672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.144672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.144672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.144672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.145434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.145434 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.152745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1394/2744] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:17.154443 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.168091 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc98c5-0306-4edf-bfef-6259210cdeff admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.173692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.174580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.175075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.175580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.186621 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.188263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3e9d-5a6c-4f3c-8a75-799fb202867d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.205852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1351/2745] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:17.213268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.224287 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a5cec-b677-499f-a22f-1d6f004486e1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.230209 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.233187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.233187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.233187 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] PATH_INFO: `/v3/projects/e0fdf4ed079e44e1879409c53f7993fc/users/2fb51fbd2c894aef8179b4e6d1b2d71f/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.250799 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fdf4ed079e44e1879409c53f7993fc, user_id=2fb51fbd2c894aef8179b4e6d1b2d71f, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.253585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.267564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1395/2746] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:17 2022] PUT /identity/v3/projects/e0fdf4ed079e44e1879409c53f7993fc/users/2fb51fbd2c894aef8179b4e6d1b2d71f/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:17.278362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.278635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.278906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.309749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] MFA Rules not processed for user `2fb51fbd2c894aef8179b4e6d1b2d71f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:17.311020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:17.376932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1352/2747] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:17.381572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.448436 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936174-eec8-402c-bcbc-32e15ea36a45 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.453096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.453703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.453985 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.454261 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.454909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.456817 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.484297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1396/2748] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:17 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:36:17.488647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.499392 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3e40-b1b4-41fc-a304-b3b0afb1879d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.536044 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:17.567911 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.568759 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.569134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.569417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.570055 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.572466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.595048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1353/2749] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:17 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:17.599760 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.610437 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48b2-3684-4d7b-bfb7-7c59613c1ddb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.615120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.615767 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.616051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.616327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.617011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.618613 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.629053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1397/2750] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:17.633821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.643975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede712b-0193-4871-9fb4-6d84bf04cc2e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.651502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.652181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.652458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.652753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] PATH_INFO: `/v3/projects/183ebd729c0d48659d8b565b53884a2a/users/56fabfc98c684ed1b8b79fa5a8d4236b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.678053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] RBAC: Authorizing `identity:create_grant(project_id=183ebd729c0d48659d8b565b53884a2a, user_id=56fabfc98c684ed1b8b79fa5a8d4236b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.681169 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.696264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1354/2751] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:17 2022] PUT /identity/v3/projects/183ebd729c0d48659d8b565b53884a2a/users/56fabfc98c684ed1b8b79fa5a8d4236b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:36:17.700370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.710420 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325e80-ad07-4e98-82e4-f1e703b65b65 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.716298 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:17.774104 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.774632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.774907 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.775205 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.775957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.777564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2274a7-5802-4c1c-85d6-effd68ab85e2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.788651 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1398/2752] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:36:17.792433 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.802950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b0a9-fddf-4d03-8a84-fc9fc9a2232d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:17.808105 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:17.808797 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.809082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.809467 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] PATH_INFO: `/v3/projects/183ebd729c0d48659d8b565b53884a2a/users/56fabfc98c684ed1b8b79fa5a8d4236b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.811399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183ebd729c0d48659d8b565b53884a2a, user_id=56fabfc98c684ed1b8b79fa5a8d4236b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:17.814049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:17.825688 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1355/2753] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:17 2022] PUT /identity/v3/projects/183ebd729c0d48659d8b565b53884a2a/users/56fabfc98c684ed1b8b79fa5a8d4236b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:36:17.839269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:17.839632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:17.840539 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:17.870647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] MFA Rules not processed for user `56fabfc98c684ed1b8b79fa5a8d4236b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:17.871980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:17.950399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1399/2754] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:17.961250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:17.963104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:18.022966 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879d2b5-2b06-46fc-98a9-6903a97149c2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:18.026737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:18.027285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:18.027565 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:18.027841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:18.037469 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:18.039042 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5769b-32fb-402f-965e-961a0a91f73e service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:18.061587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1356/2755] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:18.543683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:18.622003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84befa-c679-4ed8-902c-e40f484f68f4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:18.628570 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:18.629213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:18.629498 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:18.629766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] PATH_INFO: `/v3/users/2fb51fbd2c894aef8179b4e6d1b2d71f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:18.631460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb51fbd2c894aef8179b4e6d1b2d71f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:18.633634 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:18.680305 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:18.695924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb51fbd2c894aef8179b4e6d1b2d71f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:18.713194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb51fbd2c894aef8179b4e6d1b2d71f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:18.714033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb51fbd2c894aef8179b4e6d1b2d71f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:18.722443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb51fbd2c894aef8179b4e6d1b2d71f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:18.723253 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb51fbd2c894aef8179b4e6d1b2d71f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:18.737797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1400/2756] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:18 2022] DELETE /identity/v3/users/2fb51fbd2c894aef8179b4e6d1b2d71f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:18.742370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:18.742931 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:18.743032 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:18.762721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:18.764148 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:18.845120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1357/2757] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:18.855778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:18.857263 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:18.918345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a203d24-67d3-4f76-a061-b1b3ee1cdb2c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:18.922243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:18.922851 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:18.923138 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:18.923411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:18.932377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:18.933835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:18.943120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1401/2758] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:19.228817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:19.230804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:19.247084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc9e01-a6d9-4087-a670-ca8dd6663ca8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:19.251832 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:19.252823 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:19.253256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:19.253696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] PATH_INFO: `/v3/projects/e0fdf4ed079e44e1879409c53f7993fc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:19.254991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fdf4ed079e44e1879409c53f7993fc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:19.257893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:19.290754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:19.309923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fdf4ed079e44e1879409c53f7993fc', 'request_id': 'req-be0f1978-52d5-4e97-802e-1d545e530d87'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.316243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fdf4ed079e44e1879409c53f7993fc', 'request_id': 'req-be0f1978-52d5-4e97-802e-1d545e530d87'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.323440 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fdf4ed079e44e1879409c53f7993fc', 'request_id': 'req-be0f1978-52d5-4e97-802e-1d545e530d87'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.335181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] The token cache is being invalidate because project e0fdf4ed079e44e1879409c53f7993fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:19.335470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.336140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.337687 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1358/2759] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:19 2022] DELETE /identity/v3/projects/e0fdf4ed079e44e1879409c53f7993fc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:19.341758 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:19.354846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49bc0-73d0-48db-9555-97790dedb4cc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:19.430320 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:19.431866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:19.433475 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:19.434200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:19.434401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:19.434735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] PATH_INFO: `/v3/users/56fabfc98c684ed1b8b79fa5a8d4236b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:19.435814 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fabfc98c684ed1b8b79fa5a8d4236b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:19.437772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:19.486274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fabfc98c684ed1b8b79fa5a8d4236b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.491360 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:19.494385 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1978-52d5-4e97-802e-1d545e530d87 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:19.502462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fabfc98c684ed1b8b79fa5a8d4236b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.503310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fabfc98c684ed1b8b79fa5a8d4236b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.504760 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:19.505379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:19.505661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:19.505933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:19.507871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:19.513469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fabfc98c684ed1b8b79fa5a8d4236b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.514123 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fabfc98c684ed1b8b79fa5a8d4236b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:19.524009 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:19.525504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:19.534241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1402/2760] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:19 2022] DELETE /identity/v3/users/56fabfc98c684ed1b8b79fa5a8d4236b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:19.539001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1359/2761] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:36:20.183915 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.185332 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:20.282457 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ccbfc-4412-4d72-a39b-3314988c1dbb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.283903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.285456 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:20.287713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.288348 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.288672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.288977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] PATH_INFO: `/v3/projects/183ebd729c0d48659d8b565b53884a2a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.290166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183ebd729c0d48659d8b565b53884a2a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.292052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.297842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca70ab-67de-45b3-bace-d197ca7e637c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.345007 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183ebd729c0d48659d8b565b53884a2a', 'request_id': 'req-0e08a0fb-3a47-4285-accd-306bb70306f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:20.351034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183ebd729c0d48659d8b565b53884a2a', 'request_id': 'req-0e08a0fb-3a47-4285-accd-306bb70306f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:20.358664 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.359531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.360087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.360474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183ebd729c0d48659d8b565b53884a2a', 'request_id': 'req-0e08a0fb-3a47-4285-accd-306bb70306f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:20.360773 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.362913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:20.379789 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] The token cache is being invalidate because project 183ebd729c0d48659d8b565b53884a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:20.380113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:20.380871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e08a0fb-3a47-4285-accd-306bb70306f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:20.382722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1403/2762] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:20 2022] DELETE /identity/v3/projects/183ebd729c0d48659d8b565b53884a2a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:20.389080 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.389364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.389638 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.411664 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:20.413096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:20.449821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.451580 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674f144-9d83-4cdb-9a71-32180240e0f9 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.462965 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1360/2763] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:36:20.476412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1404/2764] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:20.485094 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.485572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.485917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.502980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:20.512921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:20.516635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:20.528602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1361/2765] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:20.531575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.537330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:20.544732 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea2e2-ac4e-4d01-9579-47e302290558 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.551725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.552190 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.552886 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.553630 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.554116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:36:20.554645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.557455 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.573212 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1405/2766] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:36:20.575264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.585360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e974d-1c94-42b4-ba05-d9fb8314f626 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.590732 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.591484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.591881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.592178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.592921 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.595692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.627637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1362/2767] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:20 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:36:20.633133 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.645844 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bcc27-34cf-4b33-8688-237c30f4e27a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.713751 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.714350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.714769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.714875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.715528 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.717540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.746370 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1406/2768] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:20 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:20.750498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.770594 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529af6a-1901-4e06-b959-d0a5dc1c9739 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.777577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.777907 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.778198 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.779736 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.780554 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.784700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.797949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1363/2769] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:20.801983 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.812945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cfc5c-de0f-4b02-93c6-83e217c94da6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.821881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.822608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.822975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.823316 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.824034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.825741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740a21a-4d15-4efa-93cd-2d8456df061c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.847067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1407/2770] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:36:20.850855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:20.863802 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bcd0-211d-477e-9bcc-e3aeab3a47b9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:20.869515 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:20.870264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.870615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.871168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] PATH_INFO: `/v3/projects/11ea9adb10e24a819748a71e37065c17/users/5c5db86013ae4173b99a4e0e81df01bc/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.895121 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ea9adb10e24a819748a71e37065c17, user_id=5c5db86013ae4173b99a4e0e81df01bc, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:20.899307 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:20.919638 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1364/2771] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:20 2022] PUT /identity/v3/projects/11ea9adb10e24a819748a71e37065c17/users/5c5db86013ae4173b99a4e0e81df01bc/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:20.930067 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:20.930657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:20.931126 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:20.969008 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] MFA Rules not processed for user `5c5db86013ae4173b99a4e0e81df01bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:20.970264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:21.060514 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1408/2772] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:21.074534 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:21.076379 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:21.144179 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576bb15-a0e9-4152-a5ab-c3f996ab6af3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:21.147890 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572694e1f16040bea41fa0445501d01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:21.148553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:21.148861 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:21.149134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:21.158646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:21.160099 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:21.171412 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1365/2773] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:36:27.781045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:27.782601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:27.857236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:27.858661 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:27.861281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:27.879655 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef569ce-bcff-433b-a189-5ece9e8af247 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:27.885299 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:27.886071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:27.886176 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:27.886442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:27.896340 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:27.909098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:27.910672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:27.921376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1409/2774] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:27.963250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36dd9-58c5-4367-9219-0abd897a21e9 service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:27.968112 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:27.968776 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:27.969058 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:27.969336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] PATH_INFO: `/v3/users/fa89a469af8a4bed82778f6c48f1d604` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:27.970476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa89a469af8a4bed82778f6c48f1d604)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:27.972390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:28.019159 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa89a469af8a4bed82778f6c48f1d604'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.019865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa89a469af8a4bed82778f6c48f1d604'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.020493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa89a469af8a4bed82778f6c48f1d604'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.021856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:28.030041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa89a469af8a4bed82778f6c48f1d604'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.043365 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa89a469af8a4bed82778f6c48f1d604'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.056549 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1366/2775] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:27 2022] DELETE /identity/v3/users/fa89a469af8a4bed82778f6c48f1d604 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:36:28.233781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:28.246975 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696eb31-99f7-4433-86d5-570d92f5d194 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:28.306166 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:28.306792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:28.307267 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:28.307545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] PATH_INFO: `/v3/projects/d4b2f4db293f4a25bb5edd562bdbdff1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:28.308862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b2f4db293f4a25bb5edd562bdbdff1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:28.310933 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:28.358890 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b2f4db293f4a25bb5edd562bdbdff1', 'request_id': 'req-949922bb-0eab-4757-b9fe-46800450a525'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.364269 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b2f4db293f4a25bb5edd562bdbdff1', 'request_id': 'req-949922bb-0eab-4757-b9fe-46800450a525'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.372352 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b2f4db293f4a25bb5edd562bdbdff1', 'request_id': 'req-949922bb-0eab-4757-b9fe-46800450a525'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.385137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] The token cache is being invalidate because project d4b2f4db293f4a25bb5edd562bdbdff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:28.385428 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.386086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.387560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1410/2776] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:28 2022] DELETE /identity/v3/projects/d4b2f4db293f4a25bb5edd562bdbdff1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:28.391733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:28.393140 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:28.409093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29b5d-50fa-4ae1-864a-a516133cbaea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:28.485990 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:28.486635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:28.486917 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:28.487225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] PATH_INFO: `/v3/users/770bb3ff0cb94295b9ee3af2552de05f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:28.488362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=770bb3ff0cb94295b9ee3af2552de05f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:28.490342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:28.543092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770bb3ff0cb94295b9ee3af2552de05f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.543778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770bb3ff0cb94295b9ee3af2552de05f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.544383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770bb3ff0cb94295b9ee3af2552de05f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.551270 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770bb3ff0cb94295b9ee3af2552de05f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.563723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770bb3ff0cb94295b9ee3af2552de05f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.579118 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1367/2777] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:28 2022] DELETE /identity/v3/users/770bb3ff0cb94295b9ee3af2552de05f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:28.758443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:28.761680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:28.794875 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949922bb-0eab-4757-b9fe-46800450a525 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:28.856160 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:28.856818 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:28.857099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:28.857372 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] PATH_INFO: `/v3/projects/fd910caf80f04c08956822f31bfd967e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:28.858464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd910caf80f04c08956822f31bfd967e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:28.860350 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:28.882154 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:28.907243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd910caf80f04c08956822f31bfd967e', 'request_id': 'req-da13915c-d2fd-4611-9c8f-c69d2a01add6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.912653 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd910caf80f04c08956822f31bfd967e', 'request_id': 'req-da13915c-d2fd-4611-9c8f-c69d2a01add6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.920470 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd910caf80f04c08956822f31bfd967e', 'request_id': 'req-da13915c-d2fd-4611-9c8f-c69d2a01add6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.932529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] The token cache is being invalidate because project fd910caf80f04c08956822f31bfd967e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:28.932881 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.933581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da13915c-d2fd-4611-9c8f-c69d2a01add6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:28.935188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1411/2778] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:28 2022] DELETE /identity/v3/projects/fd910caf80f04c08956822f31bfd967e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:35.960836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:35.962322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:35.974856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca169a9-aa0d-4059-8bec-2cf94eb83139 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.015944 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:36.032093 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.032751 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.033031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.033301 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] PATH_INFO: `/v3/users/5c5db86013ae4173b99a4e0e81df01bc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.034394 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5db86013ae4173b99a4e0e81df01bc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.036286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.080480 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5db86013ae4173b99a4e0e81df01bc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.081150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5db86013ae4173b99a4e0e81df01bc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.081753 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5db86013ae4173b99a4e0e81df01bc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.088490 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5db86013ae4173b99a4e0e81df01bc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.100271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5db86013ae4173b99a4e0e81df01bc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.112981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1368/2779] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:36:35 2022] DELETE /identity/v3/users/5c5db86013ae4173b99a4e0e81df01bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:36.117976 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.118440 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.118560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.139450 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:36.140813 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:36.198947 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1412/2780] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:36.208720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.210156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:36.266466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043c0df-ef2c-4174-9416-4b487c4cbeee admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.270217 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.270813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.271095 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.271366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.280859 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.282273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebde9-6fde-44b1-aadc-c9e912cff94f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.292152 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1369/2781] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:36.561650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.563094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:36.578050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea5f1-8545-454d-be6d-3bed0cf469ed None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.582778 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.583412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.583729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.584004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] PATH_INFO: `/v3/projects/11ea9adb10e24a819748a71e37065c17` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.585229 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ea9adb10e24a819748a71e37065c17)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.587576 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.634593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ea9adb10e24a819748a71e37065c17', 'request_id': 'req-7f2525b7-4172-4ac7-ad95-903ac411f000'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.640029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ea9adb10e24a819748a71e37065c17', 'request_id': 'req-7f2525b7-4172-4ac7-ad95-903ac411f000'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.648663 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ea9adb10e24a819748a71e37065c17', 'request_id': 'req-7f2525b7-4172-4ac7-ad95-903ac411f000'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.659835 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] The token cache is being invalidate because project 11ea9adb10e24a819748a71e37065c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:36:36.660129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.660787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7f2525b7-4172-4ac7-ad95-903ac411f000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:36:36.662256 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1413/2782] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:36:36 2022] DELETE /identity/v3/projects/11ea9adb10e24a819748a71e37065c17 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:36.667769 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991744-1483-45cf-8b6f-bd02888767da None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.668059 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991744-1483-45cf-8b6f-bd02888767da None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.668336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991744-1483-45cf-8b6f-bd02888767da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.688883 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-91991744-1483-45cf-8b6f-bd02888767da None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:36.690063 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-91991744-1483-45cf-8b6f-bd02888767da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:36.747528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1370/2783] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:36.755057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.755346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.755625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.775832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:36.777096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:36.785001 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1414/2784] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:36.789675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91991744-1483-45cf-8b6f-bd02888767da None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.799194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91991744-1483-45cf-8b6f-bd02888767da None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.804134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.804805 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.805087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.805361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.806001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:36:36.806306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.807884 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.809376 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:36.821855 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1371/2785] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:36:36.826136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.835270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a99e8-91b0-4665-b051-0f4bcd191f2f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.840426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.841050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.841330 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.841607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.842238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.844113 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.871188 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1415/2786] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:36:36 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:36:36.875725 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.885373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac142ae-3e77-4579-9f38-68234f6f9961 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.939591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.940185 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.940462 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.940766 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.941384 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.943261 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:36.965132 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1372/2787] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:36:36 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:36:36.969654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:36.975148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:36.981680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2e344-d1ac-45d4-bd12-407aaf046b8d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:36.987059 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:36.987657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:36.987969 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:36.988273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:36.988943 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:36.990547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:37.000511 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1416/2788] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:37.004326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:37.014374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62738fc-a2d6-40c8-ab31-b94674d5efd1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:37.018894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:37.019476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:37.019752 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:37.020027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:37.020695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:37.022250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4c359-195f-4f40-a9c3-02ae8949124f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:37.033013 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1373/2789] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:36:37.036904 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:37.046657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d096-9ad5-4aee-a5e4-af9a85635ff1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:37.051319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:37.051980 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:37.052292 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:37.052642 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] PATH_INFO: `/v3/projects/188f4c3f187a46d89f52b4e45d0cbec0/users/ba194bf27bce4502b2c7ae00ef4b3545/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:37.067406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188f4c3f187a46d89f52b4e45d0cbec0, user_id=ba194bf27bce4502b2c7ae00ef4b3545, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:37.070569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:37.083063 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1417/2790] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:36:37 2022] PUT /identity/v3/projects/188f4c3f187a46d89f52b4e45d0cbec0/users/ba194bf27bce4502b2c7ae00ef4b3545/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:36:37.088619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a0c7-a184-475a-a6e5-f1049edfff5d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:37.088916 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a0c7-a184-475a-a6e5-f1049edfff5d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:37.089207 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a0c7-a184-475a-a6e5-f1049edfff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:37.107784 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4633a0c7-a184-475a-a6e5-f1049edfff5d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:37.109002 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4633a0c7-a184-475a-a6e5-f1049edfff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:37.165827 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1374/2791] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:37.175542 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:37.177309 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:37.266136 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d840-27f9-4bdc-809e-e12b6880a8e7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:37.269759 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:37.270376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:37.270660 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:37.270942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:37.281139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:37.282568 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:37.291918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1418/2792] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:36:37.908312 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d76-2ee7-42a9-b959-70b39984f088 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:37.908620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d76-2ee7-42a9-b959-70b39984f088 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:37.908901 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441d76-2ee7-42a9-b959-70b39984f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:37.938138 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-18441d76-2ee7-42a9-b959-70b39984f088 None None] MFA Rules not processed for user `ba194bf27bce4502b2c7ae00ef4b3545`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:37.939339 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-18441d76-2ee7-42a9-b959-70b39984f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:38.006171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1375/2793] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:38.017276 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:36:38.018910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:38.081783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def46-2431-4044-ae0c-de8336fbb532 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:36:38.087042 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:36:38.087923 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:38.088342 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:38.088798 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:38.101619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:36:38.104465 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362d72d-5b6e-4049-8426-94a7c7690eec service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:36:38.116608 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1419/2794] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:36:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:36:39.470967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0beb8-b824-46f5-88ac-22a8fac092eb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:39.471465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0beb8-b824-46f5-88ac-22a8fac092eb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:39.471577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0beb8-b824-46f5-88ac-22a8fac092eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:39.478957 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:39.493295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fbc0beb8-b824-46f5-88ac-22a8fac092eb None None] MFA Rules not processed for user `ba194bf27bce4502b2c7ae00ef4b3545`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:39.494500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fbc0beb8-b824-46f5-88ac-22a8fac092eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:39.501401 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1376/2795] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:36:48.112100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:49.487974 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:54.581336 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:36:54.582189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:36:54.582189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:36:54.601028 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] MFA Rules not processed for user `ba194bf27bce4502b2c7ae00ef4b3545`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:36:54.602238 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:36:54.609523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1420/2796] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:36:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:37:04.595678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:07.073400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbfff2-d688-4c57-94a3-410a6047be85 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:07.074393 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbfff2-d688-4c57-94a3-410a6047be85 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:07.074662 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbfff2-d688-4c57-94a3-410a6047be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:07.093946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4bfbfff2-d688-4c57-94a3-410a6047be85 None None] MFA Rules not processed for user `da518b81a4604dccb098fa26514e444a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:37:07.095142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4bfbfff2-d688-4c57-94a3-410a6047be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:07.156793 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1377/2797] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:37:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:37:07.483547 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:07.485004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:07.497572 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21b12-e95f-4a90-8a77-4bbe31a39cd6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:07.501124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:07.501717 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:07.501997 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:07.502268 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:07.503891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:07.513683 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:07.515073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:07.523110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1421/2798] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:37:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:37:09.611445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161619d-6893-480f-a830-fe235fd79406 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:09.611962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161619d-6893-480f-a830-fe235fd79406 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:09.612072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161619d-6893-480f-a830-fe235fd79406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:09.643846 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5161619d-6893-480f-a830-fe235fd79406 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:37:09.645178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5161619d-6893-480f-a830-fe235fd79406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:09.708703 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1378/2799] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Sep 9 06:37:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:37:09.756025 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:09.757727 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:09.840078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0c50-c38d-49ec-967e-5b80d0ba8757 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:09.845388 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:09.846004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:09.846286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:09.846561 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:09.856792 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:09.858601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c4fc0-f09a-4cf2-9792-150901b9658c service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:09.869545 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1422/2800] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:37:19.701243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=50 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:19.864815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=38 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:23.441566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161619d-6893-480f-a830-fe235fd79406 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:23.443005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5161619d-6893-480f-a830-fe235fd79406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:23.593123 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161619d-6893-480f-a830-fe235fd79406 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:23.598276 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:23.598889 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:23.599168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:23.599438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:23.601240 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:23.614722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:23.616520 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:23.627471 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1379/2801] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:37:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 06:37:26.420588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:26.421100 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:26.421220 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:26.450259 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:37:26.451446 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:26.465171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1423/2802] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:37:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:37:26.477982 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:26.489397 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d22fe-90a6-42ca-a1b8-e9a4b6f403e3 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:26.495036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:26.495627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:26.495908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:26.496183 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:26.503975 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:26.505581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:26.514354 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1380/2803] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:37:28.399662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:28.429781 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00329bd-05f2-4fb8-9c19-2ea60a873eda None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:28.434380 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:28.435004 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:28.435288 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:28.435583 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] PATH_INFO: `/v3/users/ba194bf27bce4502b2c7ae00ef4b3545` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:28.436725 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba194bf27bce4502b2c7ae00ef4b3545)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:28.438626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:28.485816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba194bf27bce4502b2c7ae00ef4b3545'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.497795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba194bf27bce4502b2c7ae00ef4b3545'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.498494 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba194bf27bce4502b2c7ae00ef4b3545'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.505278 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba194bf27bce4502b2c7ae00ef4b3545'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.505906 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-38d63b91-40ea-4965-bed7-354aa3b3c657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba194bf27bce4502b2c7ae00ef4b3545'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.518590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1424/2804] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:37:28 2022] DELETE /identity/v3/users/ba194bf27bce4502b2c7ae00ef4b3545 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:37:28.685518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:28.696535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb14f-f31d-43b3-8570-965f9ad40e2c service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:28.756264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:28.756950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:28.757234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:28.757509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] PATH_INFO: `/v3/projects/188f4c3f187a46d89f52b4e45d0cbec0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:28.758652 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188f4c3f187a46d89f52b4e45d0cbec0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:28.760615 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:28.771977 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:28.808964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188f4c3f187a46d89f52b4e45d0cbec0', 'request_id': 'req-bfb4f998-40b8-4a34-baf9-77a21a930bd1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.815306 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188f4c3f187a46d89f52b4e45d0cbec0', 'request_id': 'req-bfb4f998-40b8-4a34-baf9-77a21a930bd1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.822154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188f4c3f187a46d89f52b4e45d0cbec0', 'request_id': 'req-bfb4f998-40b8-4a34-baf9-77a21a930bd1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.846308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] The token cache is being invalidate because project 188f4c3f187a46d89f52b4e45d0cbec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:37:28.846604 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.847228 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:37:28.848738 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1381/2805] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:37:28 2022] DELETE /identity/v3/projects/188f4c3f187a46d89f52b4e45d0cbec0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:37:38.515011 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:38.844037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:57.862184 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:57.863024 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:57.863303 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:57.883500 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] MFA Rules not processed for user `a64a8f621ee244ceb531caa37d6cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:37:57.884726 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:57.941403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1425/2806] 10.222.0.30 () {58 vars in 967 bytes} [Fri Sep 9 06:37:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:37:57.954516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:37:57.955964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:37:58.030767 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4f998-40b8-4a34-baf9-77a21a930bd1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:37:58.036744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10878995ca2b405e975f1929d737a2ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:37:58.037626 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:37:58.037993 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:37:58.038271 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:37:58.051034 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:37:58.052651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:37:58.061147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1382/2807] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Sep 9 06:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 06:38:04.813920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:04.815552 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:04.896645 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd757eb-3680-4b74-9bdc-d9fae03c0742 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:04.901415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:04.902049 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:04.902333 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:04.902609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] PATH_INFO: `/v3/users/79ee2ce624074c31bd3f83ecb3f46153` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:04.903753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ee2ce624074c31bd3f83ecb3f46153)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:04.905699 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:04.953523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ee2ce624074c31bd3f83ecb3f46153'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:04.967529 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ee2ce624074c31bd3f83ecb3f46153'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:04.968260 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ee2ce624074c31bd3f83ecb3f46153'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:04.975411 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ee2ce624074c31bd3f83ecb3f46153'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:04.976670 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ee2ce624074c31bd3f83ecb3f46153'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:04.990367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1426/2808] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:04 2022] DELETE /identity/v3/users/79ee2ce624074c31bd3f83ecb3f46153 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:05.176464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:05.207031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b90a02-0063-4a47-b58d-661008a2aaa8 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:05.277692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:05.278629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:05.278941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:05.279318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] PATH_INFO: `/v3/projects/fe9d613a7ee84909aa63baf95324130a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:05.280647 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9d613a7ee84909aa63baf95324130a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:05.282996 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:05.343918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9d613a7ee84909aa63baf95324130a', 'request_id': 'req-8253712e-9c0f-406f-a2d4-4db9fb3b7673'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.350625 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9d613a7ee84909aa63baf95324130a', 'request_id': 'req-8253712e-9c0f-406f-a2d4-4db9fb3b7673'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.356523 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9d613a7ee84909aa63baf95324130a', 'request_id': 'req-8253712e-9c0f-406f-a2d4-4db9fb3b7673'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.369675 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] The token cache is being invalidate because project fe9d613a7ee84909aa63baf95324130a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:05.369983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.370602 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.372075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1383/2809] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:05 2022] DELETE /identity/v3/projects/fe9d613a7ee84909aa63baf95324130a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:05.376296 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:05.377860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:05.391302 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3455-b1de-4555-97c6-6dd6fcca2460 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:05.410762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:05.449624 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:05.450241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:05.450523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:05.450795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] PATH_INFO: `/v3/users/64852d97f45741f98f9563dda9dbb96d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:05.451898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64852d97f45741f98f9563dda9dbb96d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:05.453848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:05.500894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64852d97f45741f98f9563dda9dbb96d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.513462 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64852d97f45741f98f9563dda9dbb96d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.514124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64852d97f45741f98f9563dda9dbb96d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.521218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64852d97f45741f98f9563dda9dbb96d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.521862 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64852d97f45741f98f9563dda9dbb96d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.534502 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1427/2810] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:05 2022] DELETE /identity/v3/users/64852d97f45741f98f9563dda9dbb96d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:05.715775 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:05.717296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:05.742620 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253712e-9c0f-406f-a2d4-4db9fb3b7673 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:05.765637 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:05.812233 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:05.813001 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:05.813370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:05.813749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] PATH_INFO: `/v3/projects/8d2373d7635e41dba9e2177a7dba3465` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:05.815072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2373d7635e41dba9e2177a7dba3465)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:05.817355 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:05.866324 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2373d7635e41dba9e2177a7dba3465', 'request_id': 'req-837eb9a9-65a8-445d-addc-162941d2e49a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.873182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2373d7635e41dba9e2177a7dba3465', 'request_id': 'req-837eb9a9-65a8-445d-addc-162941d2e49a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.879230 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2373d7635e41dba9e2177a7dba3465', 'request_id': 'req-837eb9a9-65a8-445d-addc-162941d2e49a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.891763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] The token cache is being invalidate because project 8d2373d7635e41dba9e2177a7dba3465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:05.892049 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.892692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:05.894176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1384/2811] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:05 2022] DELETE /identity/v3/projects/8d2373d7635e41dba9e2177a7dba3465 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:15.531027 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:15.889003 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:17.809341 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:17.815833 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:17.830745 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5bd83-9099-4d4e-930f-af0aaa921457 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:17.887258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:17.887888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:17.888168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:17.888443 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] PATH_INFO: `/v3/users/da518b81a4604dccb098fa26514e444a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:17.889591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da518b81a4604dccb098fa26514e444a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:17.891488 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:17.938452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da518b81a4604dccb098fa26514e444a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:17.951772 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da518b81a4604dccb098fa26514e444a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:17.952439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da518b81a4604dccb098fa26514e444a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:17.960081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da518b81a4604dccb098fa26514e444a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:17.960754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-163bdde6-0f4d-4041-9eea-2e066108f0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da518b81a4604dccb098fa26514e444a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:17.973697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1428/2812] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:17 2022] DELETE /identity/v3/users/da518b81a4604dccb098fa26514e444a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:18.145453 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.146914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:18.160283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb9a9-65a8-445d-addc-162941d2e49a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.219581 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.220212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.220496 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.220801 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] PATH_INFO: `/v3/projects/5fc3212c16ff43fda942f74f2925dbbe` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.221910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc3212c16ff43fda942f74f2925dbbe)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.223816 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.269342 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc3212c16ff43fda942f74f2925dbbe', 'request_id': 'req-66400f84-38de-4381-9ee8-12d47d9d7624'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:18.276266 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc3212c16ff43fda942f74f2925dbbe', 'request_id': 'req-66400f84-38de-4381-9ee8-12d47d9d7624'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:18.282388 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc3212c16ff43fda942f74f2925dbbe', 'request_id': 'req-66400f84-38de-4381-9ee8-12d47d9d7624'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:18.295499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] The token cache is being invalidate because project 5fc3212c16ff43fda942f74f2925dbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:18.295790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:18.296418 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-66400f84-38de-4381-9ee8-12d47d9d7624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:18.297933 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1385/2813] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:18 2022] DELETE /identity/v3/projects/5fc3212c16ff43fda942f74f2925dbbe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:18.302749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.303035 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.303308 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.362954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:18.364157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:18.408262 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:18.426033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1429/2814] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:18.434045 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.434337 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.434642 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.462090 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:18.463794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:18.472328 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1386/2815] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:18.477887 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.491092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf698d6-c5a9-4988-a53f-17d028b02f42 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.495909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.496609 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.496836 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.497114 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.497769 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:18.498076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.499665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.512095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1430/2816] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:38:18.516498 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.527296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10353c-cb89-4998-adda-077a88edf4cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.532211 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.532852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.533131 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.533771 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.534033 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.536010 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.564264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1387/2817] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:18.568920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.580901 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0296ff-be99-425b-be85-959b81f63ee3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.642910 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.643509 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.643787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.644055 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.644722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.647127 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.668768 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1431/2818] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:18.672906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.683077 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9456a18-2eb4-4b25-9f89-aee5040ff324 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.687720 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.688400 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.688660 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.688930 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.689559 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.691277 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.701004 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1388/2819] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:18.704927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.715099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e750-e0a7-4b7f-8311-7cc2cbac3a88 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.719657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.720243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.720523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.720830 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.721464 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.723026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a667d5c-2807-49da-82a1-5243d174f758 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.734284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1432/2820] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:18.738881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.748808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b86a4-1ad5-434d-bc96-119a9ad8d7d5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.753366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.754005 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.754281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.754553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] PATH_INFO: `/v3/projects/f383e9dd419c47b9b2e921d0e9ff3197/users/f29f399370f64252be7a9565e9b704c9/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.768504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f383e9dd419c47b9b2e921d0e9ff3197, user_id=f29f399370f64252be7a9565e9b704c9, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.771672 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.789511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1389/2821] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:18 2022] PUT /identity/v3/projects/f383e9dd419c47b9b2e921d0e9ff3197/users/f29f399370f64252be7a9565e9b704c9/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:18.802956 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.803243 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.803519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.831249 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] MFA Rules not processed for user `f29f399370f64252be7a9565e9b704c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:18.832518 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:18.895538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1433/2822] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:18.900129 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:18.931214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:18.963991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efec26b-efa3-49cd-86f6-4dff04df482e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:18.968585 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:18.969250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:18.969535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:18.969803 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:18.970421 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:18.972285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:18.998541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1390/2823] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:18 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:19.002925 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.015029 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88868ce5-6ba2-48a7-be9c-26d30b4cba22 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.058421 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:19.075968 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.076592 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.076880 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.077151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.077800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.079697 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.101695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1434/2824] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:19 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:19.105928 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.116964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7780d-b23f-4fbb-8bcf-8e058f3d96e9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.121836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.122518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.122870 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.123856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.124507 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.126127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.138402 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1391/2825] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:19.143284 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.153116 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5b7d-36f9-43db-92c9-274fc92ee1ea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.157671 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.158312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.158591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.158864 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] PATH_INFO: `/v3/projects/96ef27ec86e049e184b9c6120239458e/users/01c6b781dc604500bfcaac5e98b9f504/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.173963 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ef27ec86e049e184b9c6120239458e, user_id=01c6b781dc604500bfcaac5e98b9f504, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.176702 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.190559 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1435/2826] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:19 2022] PUT /identity/v3/projects/96ef27ec86e049e184b9c6120239458e/users/01c6b781dc604500bfcaac5e98b9f504/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:38:19.195722 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.205810 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e856439-3ec8-4d92-ae76-3f501a7a77a0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.263340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.263950 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.264232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.264508 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.265176 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.266757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2a82c-f095-40d9-a7a0-944b8712f265 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.276967 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1392/2827] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:19.281130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.291271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8d86-6f5c-4c98-ae19-fc5ae38ef8f0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.295965 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.296644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.296928 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.297204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] PATH_INFO: `/v3/projects/96ef27ec86e049e184b9c6120239458e/users/01c6b781dc604500bfcaac5e98b9f504/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.299093 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ef27ec86e049e184b9c6120239458e, user_id=01c6b781dc604500bfcaac5e98b9f504, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.302273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.312358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1436/2828] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:19 2022] PUT /identity/v3/projects/96ef27ec86e049e184b9c6120239458e/users/01c6b781dc604500bfcaac5e98b9f504/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:19.322866 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.323237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.323514 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.350464 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] MFA Rules not processed for user `01c6b781dc604500bfcaac5e98b9f504`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:19.351663 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:19.417445 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1393/2829] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:38:19.429098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.430973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:19.513648 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f5e3-6410-49b0-a427-6aa07d811dd1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.517394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.518053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.518282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.518560 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.527924 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.529369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.538728 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1437/2830] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:19.613259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:19.624331 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbe411-e03a-4909-aded-9efcdd3cc8f1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:19.627910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:19.628531 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:19.628847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:19.629116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:19.648434 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:19.686459 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:19.687937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a86b5-aee9-4525-92cd-b8f4fdc57c9c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:19.697525 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1394/2831] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:22.427115 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:22.489779 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1f2ea-d37b-4804-8d7f-19a3945f3535 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:22.494247 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:22.494876 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:22.495157 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:22.495432 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] PATH_INFO: `/v3/users/f29f399370f64252be7a9565e9b704c9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:22.496594 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29f399370f64252be7a9565e9b704c9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:22.498595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:22.519626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:22.547139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29f399370f64252be7a9565e9b704c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:22.558927 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29f399370f64252be7a9565e9b704c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:22.559595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29f399370f64252be7a9565e9b704c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:22.566379 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29f399370f64252be7a9565e9b704c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:22.568399 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29f399370f64252be7a9565e9b704c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:22.580050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1438/2832] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:22 2022] DELETE /identity/v3/users/f29f399370f64252be7a9565e9b704c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:22.585117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:22.585591 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:22.585691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:22.605011 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:22.606254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:22.667824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1395/2833] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:22.678177 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:22.679579 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:22.759134 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a6ef-e381-447b-90f6-f2b45760503e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:22.763043 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:22.763756 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:22.764118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:22.764402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:22.774168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:22.775590 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:22.785564 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1439/2834] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:23.056327 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.058098 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:23.072727 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afe1cd-fa53-4b56-9959-f48df6db14a4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:23.077910 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:23.078541 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.078817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.079108 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] PATH_INFO: `/v3/projects/f383e9dd419c47b9b2e921d0e9ff3197` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.080212 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f383e9dd419c47b9b2e921d0e9ff3197)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:23.082254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:23.129226 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f383e9dd419c47b9b2e921d0e9ff3197', 'request_id': 'req-5deaa065-6a22-4138-8dce-a27048dc33cd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.136072 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f383e9dd419c47b9b2e921d0e9ff3197', 'request_id': 'req-5deaa065-6a22-4138-8dce-a27048dc33cd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.142237 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f383e9dd419c47b9b2e921d0e9ff3197', 'request_id': 'req-5deaa065-6a22-4138-8dce-a27048dc33cd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.154551 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] The token cache is being invalidate because project f383e9dd419c47b9b2e921d0e9ff3197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:23.155006 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.155765 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.157860 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1396/2835] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:23 2022] DELETE /identity/v3/projects/f383e9dd419c47b9b2e921d0e9ff3197 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:23.162581 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.172034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517140-7bc0-488c-9741-3e61904a9e03 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:23.231685 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:23.232306 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.232607 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.232882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] PATH_INFO: `/v3/users/01c6b781dc604500bfcaac5e98b9f504` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.233977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c6b781dc604500bfcaac5e98b9f504)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:23.235860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:23.259364 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:23.284503 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c6b781dc604500bfcaac5e98b9f504'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.297012 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c6b781dc604500bfcaac5e98b9f504'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.297740 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c6b781dc604500bfcaac5e98b9f504'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.305217 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c6b781dc604500bfcaac5e98b9f504'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.305913 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5803187c-8929-41ee-9063-c6a3409a2220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c6b781dc604500bfcaac5e98b9f504'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.318563 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1440/2836] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:23 2022] DELETE /identity/v3/users/01c6b781dc604500bfcaac5e98b9f504 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:23.591308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.592819 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:23.608920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa065-6a22-4138-8dce-a27048dc33cd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:23.652540 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:23.670552 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:23.671181 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.671458 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.671758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] PATH_INFO: `/v3/projects/96ef27ec86e049e184b9c6120239458e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.672913 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ef27ec86e049e184b9c6120239458e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:23.674857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:23.726718 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ef27ec86e049e184b9c6120239458e', 'request_id': 'req-e57a3fdf-a060-4682-adda-f608d7e29037'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.733051 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ef27ec86e049e184b9c6120239458e', 'request_id': 'req-e57a3fdf-a060-4682-adda-f608d7e29037'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.739220 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ef27ec86e049e184b9c6120239458e', 'request_id': 'req-e57a3fdf-a060-4682-adda-f608d7e29037'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.753134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] The token cache is being invalidate because project 96ef27ec86e049e184b9c6120239458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:23.753426 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.754073 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e57a3fdf-a060-4682-adda-f608d7e29037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:23.755518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1397/2837] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:23 2022] DELETE /identity/v3/projects/96ef27ec86e049e184b9c6120239458e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:23.760495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.761019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.761132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.780857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:23.782084 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:23.840206 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1441/2838] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:23.849511 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.849800 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.850080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.871984 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:23.873208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:23.881535 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1398/2839] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:38:23.885839 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.895981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28b4e4-ce31-4e02-a014-4e3a81157221 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:23.901369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:23.902099 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.902425 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.902757 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.903507 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:23.903816 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:23.905426 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:23.917026 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1442/2840] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:38:23.921262 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.930937 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68d69a-1c9c-46e2-9f2b-cdfa17ffa87b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:23.935680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:23.936256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:23.936529 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:23.936838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:23.937466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:23.939353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:23.970079 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1399/2841] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:23 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:23.971198 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:23.981533 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9201-34a5-48ee-9d08-f1029ae06d2f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.039676 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.040274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.040703 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.041002 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.041684 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.043615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.065053 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1443/2842] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:23 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:24.069310 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.080273 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e1d50-d255-4862-8e39-aad88363309b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.085518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.086116 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.086589 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.086964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.087704 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.089903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.101804 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1400/2843] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:38:24.105893 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.116381 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c61c7-311f-438e-8785-3b20755f662e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.122098 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.122986 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.123270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.123548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.124200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.125917 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93659208-cb8e-4cad-98e6-35ac8cb2c871 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.138297 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1444/2844] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 06:38:24.142484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.153398 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8f58-9cd4-4ab8-ad41-556e1d97f668 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.158119 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.158764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.159047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.159322 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] PATH_INFO: `/v3/projects/368b883c0e754c36827b845b617f79be/users/cbe0afc1d9f54998805edf473760a341/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.174281 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368b883c0e754c36827b845b617f79be, user_id=cbe0afc1d9f54998805edf473760a341, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.177050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.190924 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1401/2845] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:24 2022] PUT /identity/v3/projects/368b883c0e754c36827b845b617f79be/users/cbe0afc1d9f54998805edf473760a341/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:24.202135 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.202423 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.202701 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.216787 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:24.233255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] MFA Rules not processed for user `cbe0afc1d9f54998805edf473760a341`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:24.234544 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:24.300753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1445/2846] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:38:24.305338 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.366050 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01c83f-5305-4882-910a-3fd463e733f3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.370557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.371157 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.371438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.371713 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.372353 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.374295 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.389553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:24.402945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1402/2847] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:24.406954 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.418580 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6f63b-4087-4cc3-9c37-85fc9db4a4c5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.473918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.474803 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.475110 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.475376 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.475987 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.477891 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.499909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1446/2848] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:24.503981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.514360 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f32b4d-8e5d-47ab-81c7-8c8180d3e303 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.518992 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.519587 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.520380 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.520685 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.521323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.522896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.533272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1403/2849] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:24.537667 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.548658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d51ab-0cff-46f3-9bb4-f6b1bf62c802 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.553264 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.553855 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.554137 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.554412 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.555052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.556657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab252c-2d55-4b94-8075-14911777c3af admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.566691 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1447/2850] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:24.570684 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.582158 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309449-35c2-49be-8ef4-89a5ed3bd765 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.589584 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.590243 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.590521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.590790 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] PATH_INFO: `/v3/projects/41213ce479c44c26a2f03df264423aa3/users/1946d086ae224d45aefed9f7990271f5/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.609259 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=41213ce479c44c26a2f03df264423aa3, user_id=1946d086ae224d45aefed9f7990271f5, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.611920 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.624871 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1404/2851] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:24 2022] PUT /identity/v3/projects/41213ce479c44c26a2f03df264423aa3/users/1946d086ae224d45aefed9f7990271f5/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:24.635429 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.635871 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.636241 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.665358 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] MFA Rules not processed for user `1946d086ae224d45aefed9f7990271f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:24.666573 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:24.733274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1448/2852] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:24.737680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.801248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42adca4-629d-4c85-8dd1-d9cd48f9f0ad admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.806082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.806686 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.806962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.807224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.807849 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.809877 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.837047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1405/2853] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:24.841191 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.848164 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:24.853124 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c8f49-70dc-4266-9d8b-1d4cc93a52f6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.911677 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.912208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.912492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.912800 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.913424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.915310 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.936625 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1449/2854] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:24 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:24.940631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.951092 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38dbf-2fd2-4dc3-a8aa-22af712ddcaa admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.955670 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.956260 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.956537 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.956837 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:24.957470 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:24.959082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:24.972343 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1406/2855] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:24.973981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:24.984170 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea60be-8b06-483f-8eb4-a9e197d4c447 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:24.989459 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:24.990101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:24.990382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:24.990658 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] PATH_INFO: `/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4/users/bb1198aae03e4c4f9f1c7d02ce21a4eb/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.005414 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab0ef067c614ba7be052c2fc8e71fe4, user_id=bb1198aae03e4c4f9f1c7d02ce21a4eb, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:25.008022 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:25.021101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1450/2856] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:24 2022] PUT /identity/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4/users/bb1198aae03e4c4f9f1c7d02ce21a4eb/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:25.025484 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:25.035194 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf997-91cb-49fb-b654-1f768c7c7c7e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:25.092221 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:25.092857 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:25.093141 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:25.093479 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.094142 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:25.095795 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4d689-b125-4670-80a2-0ebd8b4469dd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:25.106282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1407/2857] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:25.110840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:25.121647 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13a351-b213-4603-9fe7-934b6d637263 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:25.126233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:25.126873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:25.127156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:25.127431 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] PATH_INFO: `/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4/users/bb1198aae03e4c4f9f1c7d02ce21a4eb/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.129377 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab0ef067c614ba7be052c2fc8e71fe4, user_id=bb1198aae03e4c4f9f1c7d02ce21a4eb, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:25.132131 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:25.143504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1451/2858] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:25 2022] PUT /identity/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4/users/bb1198aae03e4c4f9f1c7d02ce21a4eb/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:25.156789 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:25.157020 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:25.157439 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.188556 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] MFA Rules not processed for user `bb1198aae03e4c4f9f1c7d02ce21a4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:25.189788 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:25.207939 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:25.258633 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1408/2859] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:25.269349 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:25.271538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:25.330477 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61968-b658-4d73-a1a0-191cf6572a90 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:25.334181 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:25.334783 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:25.335061 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:25.335346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.344019 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:25.345451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:25.354808 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1452/2860] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:25.873362 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:25.874743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:25.886423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7c6e8-0d5a-4b10-a7a6-ddcffc7c3759 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:25.889932 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:25.890518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:25.890794 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:25.891062 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:25.945980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:25.947390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:25.955989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1409/2861] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:29.986159 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:29.994984 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b151ab-6d0b-4163-8157-a93fc2b290c8 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:29.998661 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:29.999327 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:29.999622 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:29.999894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:30.058407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:30.059981 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f3799-b912-4ecf-90d4-7b5287f77359 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:30.063665 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:30.071366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1453/2862] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:32.151627 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:32.218828 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea768b0-93cd-44a8-b129-1dc57513f2a8 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:32.223465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:32.224087 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:32.224367 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:32.224679 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] PATH_INFO: `/v3/users/cbe0afc1d9f54998805edf473760a341` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:32.225833 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe0afc1d9f54998805edf473760a341)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:32.227730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:32.274326 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe0afc1d9f54998805edf473760a341'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.274978 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe0afc1d9f54998805edf473760a341'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.275601 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe0afc1d9f54998805edf473760a341'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.282438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe0afc1d9f54998805edf473760a341'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.283560 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:32.295695 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe0afc1d9f54998805edf473760a341'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.308908 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1410/2863] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:32 2022] DELETE /identity/v3/users/cbe0afc1d9f54998805edf473760a341 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:32.313761 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:32.314237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:32.314373 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:32.333451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:32.334632 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:32.392194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1454/2864] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:38:32.401701 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:32.403150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:32.459150 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bcae-bf53-45ed-85a4-0e0aeed20dec admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:32.462786 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:32.463497 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:32.463783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:32.464054 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:32.473395 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:32.474811 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:32.484263 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1411/2865] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:32.749730 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:32.751227 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:32.764251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d49c1-a781-485b-abf9-f4c68285dba9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:32.770221 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:32.770932 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:32.771218 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:32.771495 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] PATH_INFO: `/v3/projects/368b883c0e754c36827b845b617f79be` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:32.772809 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=368b883c0e754c36827b845b617f79be)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:32.774749 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:32.823094 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368b883c0e754c36827b845b617f79be', 'request_id': 'req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.828899 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368b883c0e754c36827b845b617f79be', 'request_id': 'req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.837857 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368b883c0e754c36827b845b617f79be', 'request_id': 'req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.850593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] The token cache is being invalidate because project 368b883c0e754c36827b845b617f79be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:32.850909 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.851551 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.853194 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1455/2866] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:32 2022] DELETE /identity/v3/projects/368b883c0e754c36827b845b617f79be => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:38:32.857465 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:32.867500 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2ab5-fb2a-4e83-af69-6251a946d689 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:32.924472 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:32.925130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:32.925435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:32.925721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] PATH_INFO: `/v3/users/1946d086ae224d45aefed9f7990271f5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:32.926886 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1946d086ae224d45aefed9f7990271f5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:32.928903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:32.975862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1946d086ae224d45aefed9f7990271f5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.976654 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1946d086ae224d45aefed9f7990271f5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.977336 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1946d086ae224d45aefed9f7990271f5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.985041 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1946d086ae224d45aefed9f7990271f5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:32.996941 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1946d086ae224d45aefed9f7990271f5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.001178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:33.013201 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1412/2867] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:32 2022] DELETE /identity/v3/users/1946d086ae224d45aefed9f7990271f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:33.290257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:33.291832 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:33.305729 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c927c-d6f4-4120-b3ad-ea15081ed03a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:33.371536 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:33.372235 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:33.372439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:33.372754 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] PATH_INFO: `/v3/projects/41213ce479c44c26a2f03df264423aa3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:33.373873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41213ce479c44c26a2f03df264423aa3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:33.375773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:33.401469 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:33.426072 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41213ce479c44c26a2f03df264423aa3', 'request_id': 'req-4f74a16f-fa09-4d5d-887d-82b9153b650c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.431540 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41213ce479c44c26a2f03df264423aa3', 'request_id': 'req-4f74a16f-fa09-4d5d-887d-82b9153b650c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.439394 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41213ce479c44c26a2f03df264423aa3', 'request_id': 'req-4f74a16f-fa09-4d5d-887d-82b9153b650c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.451091 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] The token cache is being invalidate because project 41213ce479c44c26a2f03df264423aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:33.451382 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.452068 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.453605 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1456/2868] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:33 2022] DELETE /identity/v3/projects/41213ce479c44c26a2f03df264423aa3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:33.458214 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:33.459674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:33.472199 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566dc-957d-45ef-bdfe-dce0d7ab6d70 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:33.528824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:33.529455 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:33.529840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:33.530130 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] PATH_INFO: `/v3/users/bb1198aae03e4c4f9f1c7d02ce21a4eb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:33.531274 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1198aae03e4c4f9f1c7d02ce21a4eb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:33.533492 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:33.578922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1198aae03e4c4f9f1c7d02ce21a4eb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.579566 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1198aae03e4c4f9f1c7d02ce21a4eb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.580171 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1198aae03e4c4f9f1c7d02ce21a4eb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.587082 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1198aae03e4c4f9f1c7d02ce21a4eb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.599133 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4958e7e5-2aea-43fd-aa38-c0f91aa3b683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1198aae03e4c4f9f1c7d02ce21a4eb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:33.612366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1413/2869] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:33 2022] DELETE /identity/v3/users/bb1198aae03e4c4f9f1c7d02ce21a4eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:38:33.888941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:33.890374 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:33.903402 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a16f-fa09-4d5d-887d-82b9153b650c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:33.962780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:33.963338 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:33.963619 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:33.963888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] PATH_INFO: `/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:33.965023 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab0ef067c614ba7be052c2fc8e71fe4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:33.966903 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.015051 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab0ef067c614ba7be052c2fc8e71fe4', 'request_id': 'req-9a9da33a-0235-4c57-ade7-2f7976ee03d0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:34.021143 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab0ef067c614ba7be052c2fc8e71fe4', 'request_id': 'req-9a9da33a-0235-4c57-ade7-2f7976ee03d0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:34.031977 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab0ef067c614ba7be052c2fc8e71fe4', 'request_id': 'req-9a9da33a-0235-4c57-ade7-2f7976ee03d0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:34.043595 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] The token cache is being invalidate because project 5ab0ef067c614ba7be052c2fc8e71fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:34.043882 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:34.044527 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9a9da33a-0235-4c57-ade7-2f7976ee03d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:34.046030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1457/2870] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:33 2022] DELETE /identity/v3/projects/5ab0ef067c614ba7be052c2fc8e71fe4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:34.052303 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.052657 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.053053 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.073542 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:34.074731 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:34.134757 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1414/2871] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:34.143254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.143735 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.144057 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.164961 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:34.166150 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:34.173949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1458/2872] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:34.177983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.189210 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ed8f4-a5d1-4505-adee-63d0797be565 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.194296 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.194894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.195170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.195437 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.196070 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:34.196370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.198066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.209856 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1415/2873] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:38:34.214318 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.223585 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a48678-8269-4706-b884-f9a336a9e8a4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.228195 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.228812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.229092 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.229362 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.230258 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.232132 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.259248 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1459/2874] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:34.263712 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.268872 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:34.275543 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4f-1a0a-452e-b1e8-d1a137c88c08 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.331708 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.332710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.333137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.333413 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.334046 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.335953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.357381 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1416/2875] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:34.361860 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.372672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113ac7-58a9-4440-8526-1c3042af1e9d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.377201 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.377786 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.378065 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.378335 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.379657 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.381254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.390941 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1460/2876] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:34.394831 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.404646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59466ef-66db-41fe-998f-b3cfa990d14f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.409258 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.409845 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.410127 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.410399 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.411035 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.412646 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398315a4-10fa-4e2d-bccd-4d479a097737 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.423031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1417/2877] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:34.427543 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.432535 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:34.438854 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b4dc-39e6-4f76-9e12-3b7663492046 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.445086 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.445720 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.445998 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.446270 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] PATH_INFO: `/v3/projects/e523ca77d35c48ca8647f55538859f7c/users/490f445c3e8e4761bff8e9adc1f6c537/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.461791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e523ca77d35c48ca8647f55538859f7c, user_id=490f445c3e8e4761bff8e9adc1f6c537, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.464435 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.477122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1461/2878] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:34 2022] PUT /identity/v3/projects/e523ca77d35c48ca8647f55538859f7c/users/490f445c3e8e4761bff8e9adc1f6c537/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:34.542487 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.543048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.543048 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.571744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] MFA Rules not processed for user `490f445c3e8e4761bff8e9adc1f6c537`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:34.572995 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:34.640577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1418/2879] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:34.645575 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.706504 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500e0e-3796-43fa-ad68-956c6161cdbd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.711668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.712257 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.712537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.712843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.713473 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.715395 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.741346 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1462/2880] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:34.745476 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.757466 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc3765-27d8-4d0c-aadc-96382f46f25e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.814502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.815115 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.815417 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.815678 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.816852 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.818758 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.835737 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:34.841595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1419/2881] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:34 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:34.845682 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.856038 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ba0a-c114-4341-a242-8634f8f15e9b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.860537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.861153 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.861439 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.861711 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.862343 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.863945 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.874204 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1463/2882] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:34.878272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.888674 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761a066-426b-4e89-b97e-efb1f40bc864 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.893272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.893962 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.894374 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.895178 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] PATH_INFO: `/v3/projects/94408a57207c476f96c136a772aba896/users/3ad1f531ec784eb8997a4a4ed0bb0c1b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.910973 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94408a57207c476f96c136a772aba896, user_id=3ad1f531ec784eb8997a4a4ed0bb0c1b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.913692 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:34.925915 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1420/2883] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:34 2022] PUT /identity/v3/projects/94408a57207c476f96c136a772aba896/users/3ad1f531ec784eb8997a4a4ed0bb0c1b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:34.929938 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:34.939654 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cfbd-97e8-4458-904b-b872d896de7c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:34.996254 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:34.996883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:34.997167 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:34.997442 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:34.998078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:34.999673 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b5a3e-8f8a-4e6f-a31e-e6644e454086 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:35.009797 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1464/2884] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:35.014414 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:35.025922 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35480d65-0cfa-44ef-a50c-e937285a5fcb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:35.030518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:35.031163 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.031444 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.031719 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] PATH_INFO: `/v3/projects/94408a57207c476f96c136a772aba896/users/3ad1f531ec784eb8997a4a4ed0bb0c1b/roles/ab615789e49a44a7956ada7180efdd20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.033696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94408a57207c476f96c136a772aba896, user_id=3ad1f531ec784eb8997a4a4ed0bb0c1b, role_id=ab615789e49a44a7956ada7180efdd20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:35.036351 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:35.046323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1421/2885] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:35 2022] PUT /identity/v3/projects/94408a57207c476f96c136a772aba896/users/3ad1f531ec784eb8997a4a4ed0bb0c1b/roles/ab615789e49a44a7956ada7180efdd20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:35.056520 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.056840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.057118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.085601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] MFA Rules not processed for user `3ad1f531ec784eb8997a4a4ed0bb0c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:35.086815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:35.124626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:35.159119 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1465/2886] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:35.170572 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:35.172294 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:35.232120 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182aca-ac20-4b47-ac1c-1ec350284530 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:35.235721 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:35.236318 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.236628 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.236905 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.246102 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:35.247571 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:35.257739 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1422/2887] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:35.330604 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:35.340407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e36e51-60fa-4c2e-8ade-45a2e6e483bc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:35.344192 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:35.344847 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.345130 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.345433 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.404101 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:35.405567 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743f06-8382-4d62-865c-4f31ce6fbf59 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:35.414834 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1466/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:35.682635 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:35.747864 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442de1a-7b9c-4d76-9528-a4c63460a3c7 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:35.752483 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:35.753089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.753373 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.754134 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] PATH_INFO: `/v3/users/490f445c3e8e4761bff8e9adc1f6c537` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.755249 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490f445c3e8e4761bff8e9adc1f6c537)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:35.757234 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:35.804991 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490f445c3e8e4761bff8e9adc1f6c537'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:35.805645 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490f445c3e8e4761bff8e9adc1f6c537'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:35.806253 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490f445c3e8e4761bff8e9adc1f6c537'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:35.813519 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490f445c3e8e4761bff8e9adc1f6c537'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:35.822030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:35.827590 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490f445c3e8e4761bff8e9adc1f6c537'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:35.840906 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1423/2889] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:35 2022] DELETE /identity/v3/users/490f445c3e8e4761bff8e9adc1f6c537 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:35.845680 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:35.845973 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:35.846255 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:35.865672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:35.866870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:35.924082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1467/2890] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:35.934282 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:35.935764 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:35.997431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664a02-d44b-46c1-a8f1-abf9f3033468 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:36.001088 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:36.001702 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:36.001980 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:36.002256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:36.011841 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:36.013254 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:36.022611 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1424/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:36.292213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:36.293678 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:36.306274 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dbdd-3ac9-4e8c-ba2d-59c09ea5691d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:36.311271 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:36.311840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:36.312122 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:36.312424 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] PATH_INFO: `/v3/projects/e523ca77d35c48ca8647f55538859f7c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:36.313582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e523ca77d35c48ca8647f55538859f7c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:36.315548 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:36.362888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e523ca77d35c48ca8647f55538859f7c', 'request_id': 'req-5ffb7713-8f3e-430a-8697-8de284acdef9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.369083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e523ca77d35c48ca8647f55538859f7c', 'request_id': 'req-5ffb7713-8f3e-430a-8697-8de284acdef9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.376286 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e523ca77d35c48ca8647f55538859f7c', 'request_id': 'req-5ffb7713-8f3e-430a-8697-8de284acdef9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.378203 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:36.390586 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] The token cache is being invalidate because project e523ca77d35c48ca8647f55538859f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:36.390873 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.391486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.393120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1468/2892] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:36 2022] DELETE /identity/v3/projects/e523ca77d35c48ca8647f55538859f7c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:36.397865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:36.407631 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d36ab-5bea-47de-800b-54d5e7ad310c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:36.463881 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:36.464502 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:36.464814 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:36.465089 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] PATH_INFO: `/v3/users/3ad1f531ec784eb8997a4a4ed0bb0c1b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:36.466238 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad1f531ec784eb8997a4a4ed0bb0c1b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:36.468135 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:36.515375 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad1f531ec784eb8997a4a4ed0bb0c1b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.516038 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad1f531ec784eb8997a4a4ed0bb0c1b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.516682 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad1f531ec784eb8997a4a4ed0bb0c1b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.524170 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad1f531ec784eb8997a4a4ed0bb0c1b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.537139 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-87071bf5-8851-414a-b350-354604dae24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad1f531ec784eb8997a4a4ed0bb0c1b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.549619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1425/2893] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:36 2022] DELETE /identity/v3/users/3ad1f531ec784eb8997a4a4ed0bb0c1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:38:36.816957 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:36.818812 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:36.834392 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7713-8f3e-430a-8697-8de284acdef9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:36.890521 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:36.891168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:36.891451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:36.891764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] PATH_INFO: `/v3/projects/94408a57207c476f96c136a772aba896` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:36.892949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94408a57207c476f96c136a772aba896)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:36.895492 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:36.941644 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94408a57207c476f96c136a772aba896', 'request_id': 'req-ad05f669-21d6-46ea-b82b-eee53ae66a28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.947277 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94408a57207c476f96c136a772aba896', 'request_id': 'req-ad05f669-21d6-46ea-b82b-eee53ae66a28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.954804 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94408a57207c476f96c136a772aba896', 'request_id': 'req-ad05f669-21d6-46ea-b82b-eee53ae66a28'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.966525 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] The token cache is being invalidate because project 94408a57207c476f96c136a772aba896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:36.966815 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.967480 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ad05f669-21d6-46ea-b82b-eee53ae66a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:36.969082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1469/2894] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:36 2022] DELETE /identity/v3/projects/94408a57207c476f96c136a772aba896 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:36.974918 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:36.975390 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:36.975504 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:36.989248 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:36.996423 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:36.998191 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.056953 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1426/2895] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:37.064453 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.064715 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.064996 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.086577 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:37.087764 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.095569 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1470/2896] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:37.099878 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.109987 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e17e55-29be-46d4-b20e-888ce42fb92b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.114636 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.115241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.115526 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.115830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.116501 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:37.116840 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.118494 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.130700 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1427/2897] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:38:37.134795 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.143843 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3dc3d-7ec3-4b5b-9336-a6112fd30f94 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.149097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.149688 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.149971 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.150246 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.150870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.152784 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.178743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1471/2898] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:37 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:37.182926 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.193577 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfca33-2e02-4659-be8c-e0e2c83ae115 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.250147 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.250749 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.251031 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.251308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.251945 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.253894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.275250 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1428/2899] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:37 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:37.280615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.294451 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3078c88-4b65-4b0d-8dd2-ad57bb3d7046 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.299237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.299842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.300149 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.300407 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.301083 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.303780 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.320448 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1472/2900] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:37.324553 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.335812 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece16da-5e18-492a-939f-77b0c547ff95 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.347316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.348499 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.348808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.349084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.349728 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.351311 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54fbd-3408-41a1-8328-4822dc40ead5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.362297 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1429/2901] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:37.366410 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.376189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05631-e123-4a2b-894f-7d86d03c1c90 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.380840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.381486 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.381766 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.382041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] PATH_INFO: `/v3/projects/2571ff44b317418ca2b7144f947d0789/users/1bdd969ae9f4400dac302847795f6331/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.396753 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2571ff44b317418ca2b7144f947d0789, user_id=1bdd969ae9f4400dac302847795f6331, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.399366 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.413034 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1473/2902] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:37 2022] PUT /identity/v3/projects/2571ff44b317418ca2b7144f947d0789/users/1bdd969ae9f4400dac302847795f6331/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:37.424696 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.425007 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.425272 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.452283 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] MFA Rules not processed for user `1bdd969ae9f4400dac302847795f6331`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:37.453533 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.516366 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1430/2903] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:37.528041 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.529842 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.556200 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:37.588050 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba66a-b426-43d3-b49d-4fd8b0b4cf5c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.591591 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.592189 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.592472 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.592790 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.601546 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.602966 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92666f83-d78c-4fe6-a9b1-b6f42ff4f091 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.612713 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1474/2904] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:37.635052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.639236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:37.697435 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19197b59-a004-4aa8-b81d-ab68798a2468 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.702104 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.702730 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.703014 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.703290 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] PATH_INFO: `/v3/users/1bdd969ae9f4400dac302847795f6331` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.704408 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdd969ae9f4400dac302847795f6331)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.706361 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.751323 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdd969ae9f4400dac302847795f6331'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:37.752027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdd969ae9f4400dac302847795f6331'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:37.752681 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdd969ae9f4400dac302847795f6331'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:37.760080 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdd969ae9f4400dac302847795f6331'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:37.772817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdd969ae9f4400dac302847795f6331'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:37.786981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1431/2905] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:37 2022] DELETE /identity/v3/users/1bdd969ae9f4400dac302847795f6331 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:37.791484 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.791774 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.792054 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.811213 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:37.812430 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.871328 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1475/2906] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 06:38:37.881538 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:37.882979 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:37.940066 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef46a6-61be-47d0-81b9-163c419d897a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:37.944224 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:37.944873 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:37.945156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:37.945431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:37.954285 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:37.955744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f5a6-943f-41f5-b28d-5f528e267456 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:37.965733 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1432/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:38.227978 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.229452 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:38.243628 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f101-9d2e-45b1-94ce-e3c2bbb01286 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.248369 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.249030 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.249312 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.249611 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] PATH_INFO: `/v3/projects/2571ff44b317418ca2b7144f947d0789` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.250782 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2571ff44b317418ca2b7144f947d0789)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.252695 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.298610 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2571ff44b317418ca2b7144f947d0789', 'request_id': 'req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:38.304097 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2571ff44b317418ca2b7144f947d0789', 'request_id': 'req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:38.311251 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2571ff44b317418ca2b7144f947d0789', 'request_id': 'req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:38.322601 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] The token cache is being invalidate because project 2571ff44b317418ca2b7144f947d0789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:38.322894 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:38.323588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c63e7ea7-41a3-495f-8ccc-dd6f8a1b30b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:38.325233 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1476/2908] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:38 2022] DELETE /identity/v3/projects/2571ff44b317418ca2b7144f947d0789 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:38.330067 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.330546 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.330741 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.350983 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:38.352174 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:38.370438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:38.411698 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1433/2909] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:38.419324 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.419612 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.419888 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.439519 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:38.440743 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:38.449139 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1477/2910] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:38.453247 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.463431 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07930af-dde9-47ba-bfba-c4c377d40acd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.468027 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.468650 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.468935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.469208 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.469850 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:38.470154 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.471763 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.483245 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1434/2911] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 06:38:38.487523 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.496785 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca966f-94c7-4344-8e64-ef57aafc71bd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.501384 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.502168 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.502281 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.502513 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.503151 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.505662 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.533474 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1478/2912] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:38 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:38.537677 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.547446 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd19c9-4115-4b3e-b9d5-c135909c17fd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.602829 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.603428 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.603709 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.603981 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.604914 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.606813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.627232 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1435/2913] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:38 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 06:38:38.631824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.641918 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05744d80-4a68-42c6-b7cc-c3860dd9e333 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.647076 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.647668 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.647949 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.648224 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.650746 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.652322 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.662148 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1479/2914] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:38.665743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.675493 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7a709-86fa-498f-98e6-faaa483c28c0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.680018 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.680632 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.680912 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.681182 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.681813 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.683370 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517f90-8874-4373-81c7-370f870b3e06 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.694358 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1436/2915] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:38.698445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.708722 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d305e-ffee-402a-b6dd-e620dffe21bc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.713282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.713920 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.714356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.714537 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] PATH_INFO: `/v3/projects/f7a2d856edf749c39e97c21ddf884f43/users/dac70866b36743e8a51ede64a58edf47/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.717621 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:38.731273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a2d856edf749c39e97c21ddf884f43, user_id=dac70866b36743e8a51ede64a58edf47, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.733942 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.746483 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1480/2916] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:38 2022] PUT /identity/v3/projects/f7a2d856edf749c39e97c21ddf884f43/users/dac70866b36743e8a51ede64a58edf47/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:38.757341 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.757629 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.757902 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.786030 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] MFA Rules not processed for user `dac70866b36743e8a51ede64a58edf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:38.787743 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:38.853047 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1437/2917] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:38.864401 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:38.866120 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:38.921762 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439979-782f-42d6-9727-915ecb950fff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:38.926223 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:38.926883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:38.926883 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:38.927078 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:38.935339 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:38.936793 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edab23-dc96-4365-80d4-e4a1468b62bb service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:38.946082 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1481/2918] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:48.850308 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:48.941467 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:48.959410 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:49.026946 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891b6e6-f827-47bc-9372-9352fb4857ac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:49.033935 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:49.034568 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.034847 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.035117 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] PATH_INFO: `/v3/users/dac70866b36743e8a51ede64a58edf47` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.036225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac70866b36743e8a51ede64a58edf47)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:49.038808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:49.086225 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac70866b36743e8a51ede64a58edf47'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.086989 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac70866b36743e8a51ede64a58edf47'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.087613 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac70866b36743e8a51ede64a58edf47'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.094382 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac70866b36743e8a51ede64a58edf47'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.106817 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac70866b36743e8a51ede64a58edf47'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.119997 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1438/2919] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:48 2022] DELETE /identity/v3/users/dac70866b36743e8a51ede64a58edf47 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:49.124557 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.124870 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.125174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.144319 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:49.145558 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:49.204208 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1482/2920] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:49.213903 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:49.215316 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:49.272710 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c938f-a7f9-491b-98d7-af8fc2a2697f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:49.276330 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:49.276959 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.277236 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.277509 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.286193 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:49.288264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eec699-d1a3-4bc3-9f73-500e0a7542b0 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:49.297574 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1439/2921] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:49.788840 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:49.790356 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:49.802095 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92eed-9fb7-4c2b-b1f6-528c449429e2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:49.806669 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:49.807300 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.807600 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.807856 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] PATH_INFO: `/v3/projects/f7a2d856edf749c39e97c21ddf884f43` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.809000 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a2d856edf749c39e97c21ddf884f43)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:49.810911 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:49.857741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a2d856edf749c39e97c21ddf884f43', 'request_id': 'req-da778c1c-0fad-456a-88e1-edc2d6e8545c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.863161 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a2d856edf749c39e97c21ddf884f43', 'request_id': 'req-da778c1c-0fad-456a-88e1-edc2d6e8545c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.870337 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a2d856edf749c39e97c21ddf884f43', 'request_id': 'req-da778c1c-0fad-456a-88e1-edc2d6e8545c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.881791 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] The token cache is being invalidate because project f7a2d856edf749c39e97c21ddf884f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:49.882073 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.882709 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da778c1c-0fad-456a-88e1-edc2d6e8545c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:49.884174 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1483/2922] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:49 2022] DELETE /identity/v3/projects/f7a2d856edf749c39e97c21ddf884f43 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 06:38:49.889110 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.889607 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.889717 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.909420 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:49.910598 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:49.926724 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:49.969824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1440/2923] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:49.977626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:49.978121 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:49.978231 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:49.999329 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:50.000445 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:50.008826 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1484/2924] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:50.013036 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.022518 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b9b4-b4a0-4781-8a90-30df09d8ed37 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.027029 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.027619 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.027896 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.028168 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.028842 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 06:38:50.029144 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.030723 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.042037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1441/2925] 10.222.0.30 () {58 vars in 1153 bytes} [Fri Sep 9 06:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 06:38:50.046045 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.055406 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dce90-a7e9-401c-9284-7127977733ee None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.059958 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.060538 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.060846 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.061118 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.061773 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.063635 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.090650 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1485/2926] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Sep 9 06:38:50 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:50.094691 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.104557 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc54be6-a709-4f3e-8988-0dbca2cded80 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.160143 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.160783 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.161068 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.161345 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.161985 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.163894 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.184824 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1442/2927] 10.222.0.30 () {60 vars in 1144 bytes} [Fri Sep 9 06:38:50 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 06:38:50.188916 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.199626 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b401a6e-cf7f-496b-9041-19d63f65afa8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.204171 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.204788 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.205071 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.205345 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.206003 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.207606 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.217301 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1486/2928] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:50.221037 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.230940 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686fabe-1c54-42ba-b232-e109f6ad5bb6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.235658 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.236241 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.236528 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.236893 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.237521 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.239075 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a8c24-10b8-438e-86dc-2f7a1474b39e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.250196 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1443/2929] 10.222.0.30 () {58 vars in 1122 bytes} [Fri Sep 9 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 06:38:50.253982 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.264245 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f97f3-ad2e-4484-a604-033294658f05 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.268824 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.269460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.269741 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.270015 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] PATH_INFO: `/v3/projects/760bfe3cfb434d939fc52f2e0400303d/users/b3f06488cb864927a65fa64fe9325373/roles/fcc0608f8ce34c0185225cd3159438bd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.284186 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760bfe3cfb434d939fc52f2e0400303d, user_id=b3f06488cb864927a65fa64fe9325373, role_id=fcc0608f8ce34c0185225cd3159438bd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.286866 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.299752 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1487/2930] 10.222.0.30 () {60 vars in 1483 bytes} [Fri Sep 9 06:38:50 2022] PUT /identity/v3/projects/760bfe3cfb434d939fc52f2e0400303d/users/b3f06488cb864927a65fa64fe9325373/roles/fcc0608f8ce34c0185225cd3159438bd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:50.310516 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.310836 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.311111 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.339782 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] MFA Rules not processed for user `b3f06488cb864927a65fa64fe9325373`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:50.341016 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:50.403218 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1444/2931] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:50.415554 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:50.417282 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:50.439796 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:50.475615 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4452-3def-4867-b9aa-270bdaf82e93 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:50.479237 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fdc7998a54c420c920fc0e54b91b930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:50.480096 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:50.480400 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:50.480712 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:50.488845 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:50.490879 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532003-4b5f-4815-a058-f46a9d6690cd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:50.499848 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1488/2932] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:55.479438 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:55.498862 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:55.542256 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be293-5f22-4cf4-9445-74af06443f4f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:55.546744 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:55.547371 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:55.547651 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:55.547923 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] PATH_INFO: `/v3/users/b3f06488cb864927a65fa64fe9325373` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:55.549061 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f06488cb864927a65fa64fe9325373)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:55.550960 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:55.595156 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f06488cb864927a65fa64fe9325373'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:55.595808 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f06488cb864927a65fa64fe9325373'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:55.596427 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f06488cb864927a65fa64fe9325373'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:55.603821 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f06488cb864927a65fa64fe9325373'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:55.616949 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f06488cb864927a65fa64fe9325373'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:55.629209 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1445/2933] 10.222.0.30 () {58 vars in 1224 bytes} [Fri Sep 9 06:38:55 2022] DELETE /identity/v3/users/b3f06488cb864927a65fa64fe9325373 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:38:55.634081 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:55.634672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:55.634672 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:55.653403 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] MFA Rules not processed for user `ceee5fe8c66c4818ace9872367307903`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 06:38:55.654593 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:55.711415 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1489/2934] 10.222.0.30 () {58 vars in 958 bytes} [Fri Sep 9 06:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 06:38:55.720865 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:55.722264 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:55.779052 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c7e47-d585-4c1c-8c00-71ab004eac15 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:55.782680 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71c93648e7be470794a3282fd043c195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:55.783279 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:55.783563 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:55.783838 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:55.794340 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:55.795754 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:55.805778 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1446/2935] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:38:56.063578 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:38:56.065156 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:38:56.077623 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66878-07b6-4663-b34c-7d2c573b31aa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:38:56.082460 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceee5fe8c66c4818ace9872367307903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39226271c3254aef844c491c22cbe083', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:38:56.083588 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:38:56.083872 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:38:56.084180 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] PATH_INFO: `/v3/projects/760bfe3cfb434d939fc52f2e0400303d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:38:56.085367 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=760bfe3cfb434d939fc52f2e0400303d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:38:56.087273 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:38:56.135033 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760bfe3cfb434d939fc52f2e0400303d', 'request_id': 'req-dbd81e21-ad19-4315-8162-18eb326fbccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:56.140582 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760bfe3cfb434d939fc52f2e0400303d', 'request_id': 'req-dbd81e21-ad19-4315-8162-18eb326fbccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:56.148898 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760bfe3cfb434d939fc52f2e0400303d', 'request_id': 'req-dbd81e21-ad19-4315-8162-18eb326fbccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:56.160039 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] The token cache is being invalidate because project 760bfe3cfb434d939fc52f2e0400303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 06:38:56.160326 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:56.160962 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dbd81e21-ad19-4315-8162-18eb326fbccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 06:38:56.163052 dv-cinder-852209-16-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1490/2936] 10.222.0.30 () {58 vars in 1233 bytes} [Fri Sep 9 06:38:56 2022] DELETE /identity/v3/projects/760bfe3cfb434d939fc52f2e0400303d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 06:39:05.800964 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:39:06.157129 dv-cinder-852209-16-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:42:28.384348 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 06:42:28.386286 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:42:28.454137 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a5fe-5a96-49e3-a680-2ae280e6e6fd service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 06:42:28.512203 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d2275234f9942e8bcf532855433d5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6b53515173d44938b161eee39ad33cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 06:42:28.512830 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 06:42:28.513113 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 06:42:28.513383 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 06:42:28.515084 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 06:42:28.525942 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 06:42:28.527595 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d48875-3a51-4445-b043-f7f51b3d9e4e service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 06:42:28.537216 dv-cinder-852209-16-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1447/2937] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Sep 9 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 06:42:38.533019 dv-cinder-852209-16-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=58 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}